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CHAPTER  I 


Introduction 

1.1.  Rationale. 

In  many  areas  of  communication  engineering,  such  as  radio  and 
television  broadcasting  and  satellite  comnunications,  one  is  con¬ 
cerned  with  the  transmission  of  several  signals  (functions)  through 
a  "channel."  Since  it  is  inefficient  to  transmit  one  signal  at  a 
time  over  the  channel,  it  is  natural  to  ask  if  it  is  possible  to 
"reconstruct"  a  continuous -time  signal  from  its  sanples  under  cer¬ 
tain  conditions  on  the  signal  and  the  sampling  scheme.  If  the  answer 
is  in  the  affirmative,  one  may  transmit  only  the  samples  of  the 
signal,  thus  occupying  the  channel  only  at  the  instants  of  san5)ling. 
Between  these  instants  the  samples  of  other  signals  can  be  transmitted. 

Another  interesting  application  of  "sanpling"  is  in  the  field  of 
sound  recording  (see,  e.g.,  Vitushkin,  1974).  The  most  widely  used 
technique  is  the  analogue  method  where  the  signal  is  recorded  without 
any  preceding  transformations.  However,  the  signals  recorded  by  this 
method  suffer  distortion  due  to  the  defects  of  recording  and  r^ro- 
duction  devices.  A  more  promising  method  of  recording  is  called  the 
digital  recording  technique.  By  this  method,  the  signal  is  first 
transformed  into  a  discrete  code.  In  other  words,  the  signal  is 
sampled  and  the  samples  are  coded;  then  the  code  of  the  signal  is 
recorded,  and  finally  the  discrete  code  is  read  off  the  recording  and 
is  transformed  into  its  continuous -time  form  in  order  to  reproduce 
the  signal.  More  precisely,  the  signal  is  reconstructed  from  the 
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(decoded)  samples  read  off  the  recording.  This  technique  has  been 
recently  enployed  with  remarkable  results. 

Clearly,  sanpling  representations  and  approximations  are  very 
significant  in  communication  and  information  theory,  especially  in 
the  era  of  digital  conputers. 

1.2.  Sampling  Representations. 

The  sanpling  representation  (expansion,  theoran) 

(1.2.1)  f(t,  =  J  ,  t.lR^  . 

was  originated  by  E.T.  Whittaker  (1915).  J.M.  Whittaker  (1929,  1935), 
Kotelnikov  (1933),  Shannon  (1949),  and  others  have  stixlied  extensively 
the  sanpling  theorem  and  its  extensions  in  developing  coiirainication 
and  information  theory.  For  a  review  of  the  sanpling  theoran,  see 
Jerri  (1977). 

A  function  f  which  can  be  represented,  for  some  W^  >  0,  by 
^0 

(1.2.2)  f(t)  =  /  e^^^^“F(u)du  ,  telR^  , 

-^0 

is  called  L^-bandlimited  to  Wq  if  FcL^[-Wq,Wq] ,  and  is  called  conven- 
2  2 

tionally  or  L  -bandlimited  to  Wq  if  FcL  [-Wq,Wq].  In  both  cases  the 
sanpling  representation  (1.2.1)  is  valid  for  all  W  s  Wq.  The  series 
in  (1.2.1)  converges  uniformly  on  caipact  sets  for  -bandlimited 
functions,  and  for  conventionally  bandlimited  functions  it  converges 
in  L  (IR  )  as  well  as  uniformly  on 

In  reconstructing  a  function  (signal)  f  from  a  periodic  set  of 
samples  (sampling  at  a  constant  rate) ,  errors  of  the  following  types 
may  arise: 
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(1)  f  is  bandlimited  but  it  is  observed  only  over  a  finite 
interval,  and  hence  only  a  finite  nuirf)er  of  sauries  can  be  used  for 
its  reconstruction.  This  type  of  error  is  called  a  truncation  error. 

(2)  f  is  bandlimited,  but  there  are  observation  errors,  so 

that  the  observed  samples  are  not  f(^)  but  f(^)  where 

are  random  variables. 

(3)  f  is  not  bandlimited  (or  not  bandlimited  to  the  frequency 
it  is  sampled  at) ,  and  yet  a  reconstruction  of  the  type  of  the 
sampling  theorem  is  attenpted. 

1.3.  Summary. 

In  this  study  the  samples  are  assumed  to  be  error  free,  and  only 
errors  of  type  (1)  and  (3)  (possibly  combined)  are  considered.  Further¬ 
more,  the  area  of  inquiry  is  limited  to  constant  rate  (or  uniform) 
sampling  schanes.  It  should  be  mentioned,  though,  that  non-uniform 
sampling  schemes,  as  well  as  random  sampling  schemes,  are  of  consider¬ 
able  interest  in  communication  and  information  processing. 

Chapter  II  deals  with  sampling  approximations  as  well  as  error 
estimates  of  functions  and  stochastic  processes  which  are  not  band- 
limited.  In  Section  2.2  a  sanpling  approximation  is  derived  for 
processes  \diich  are  not  necessarily  weakly  stationary.  In  Section  2.3 
the  rate  of  convergence  in  the  finite  sampling  approximation  for  time 
limited  processes  is  estimated;  the  convergence  holds  both  in  the 
mean  square  sense  and  with  probability  one.  Finite  sampling  approxima¬ 
tions  for  functions  which  are  Fourier  transforms  of  finite  measures 
are  derived  in  Section  2.4,  along  with  error  estimates  under  various 
conditions.  These  results  are  then  extended  to  various  types  of 
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stochastic  processes.  In  Section  2.5  Walsh  functions  are  used  to 
derive  sampling  approximations  for  functions  which  are  not  necessarily 
continuous  and  for  processes  which  are  not  necessarily  mean  square 
continuous,  as  well  as  error  estimates  under  further  conditions. 

In  Chapter  III  we  turn  to  the  problan  of  sanpling  expansions  of 
bounded  linear  operators  acting  on  various  classes  of  bandlimited 
functions  and  stochastic  processes.  The  merit  of  these  representations 
lies  in  the  fact  that  the  image  of  a  function  under  the  operator  is 
expressed  or  represented  in  terms  of  the  sanples  of  the  function 
rather  than  the  samples  of  its  image.  Section  3.2  deals  with  bounded 
linear  operators  acting  on  classes  of  functions  bandlimited  in  the  sense 
of  Zakai  (1965)  and  of  Lee  (1976a),  and  Section  3.3  considers  bounded 
linear  operators  acting  on  classes  of  functions  with  wandering  spectra 
in  Lloyd's  sense  (Lloyd,  1959). 

Finally,  in  Chapter  IV,  distributions  and  random  distributions  are 
considered.  Section  4.3  deals  with  san^iling  representations  for  dis¬ 
tributions  with  cOTipact  spectra  and  shows  that  a  distribution  with 
compact  spectrum  can  be  reconstructed  using  samples  of  its  Fourier 
transform  (regarded  as  a  function).  In  Section  4.4  similar  results 
are  derived  for  certain  types  of  randan  distributions. 

1.4.  Notation. 

The  n-dimensional  Euclidean  space  is  denoted  by  IR*',  n  ^  1, 

and  the  complex  numbers  by  C-  The  class  of  all  absolutely  integrable 

or  square  integrable  functions  on  IR*^,  with  respect  to  the  measure  y 
1  2 

is  denoted  by  L  (p)  or  L  (p) ,  and  when  the  measure  is  Lebesgue 
measure  by  L^(Ir”)  or  L^(]R").  The  complement  of  a  set  A  is  denoted 
by  A^.  Finally,  the  symbol  □  is  used  to  signal  the  end  of  each  proof. 


CHAPTER  II 


Sampling  Approximation  for  Non-Bandlimited 
Functions  and  Processes 

2.1.  Introduction. 

In  this  chapter  we  consider  the  problem  of  deriving  sampling 
approximations  and  their  rate  of  convergence  for  functions  and  stoch¬ 
astic  processes  which  are  not  necessarily  bandlimited.  The  merit  of 
these  approximations  lies  in  the  fact  that  in  many  practical  engin¬ 
eering  systems,  such  as  causal  systems  and  time-limited  systems,  the 
signals  under  consideration  are  not  bandlimited.  It  is  thus  of 
interest  to  consider  non -bandlimited  signals. 

In  Section  2.2  we  derive  a  sampling  approximation  for  stochastic 
processes  which  are  not  necessarily  stationary  or  bandlimited. 

Section  2.3  deals  with  the  rate  of  convergence  in  the  finite  sampling 
approximation  for  time-limited  stochastic  processes.  In  Section  2.4 
a  finite  sampling  approximation  is  derived  for  functions  which  are 
the  Fourier  transforms  of  finite  signed  measures,  as  well  as  the  rate 
of  convergence.  This  result  is  extended  to  weakly  stationary, 
harmonizable,  and  certain  stable  processes.  In  Section  2.5  a  sampling 
approximation  using  Walsh  functions  is  derived  for  functions  which  are 
not  necessarily  continuous  and  for  processes  which  are  not  necessarily 
mean- square  continuous. 
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2.2.  SamDiInq  Approximations  for  Non-Stationary  Stochastic  Processes. 


In  this  section  we  prove  the  stochastic  process  analogue  of  the 
sampling  approximation  theorem  proved  for  (deterministic)  non-band- 
limited  functions  of  one  variable  by  Brown  (1967) .  The  n-variable 
version  of  Brown's  result  is  stated  below  as  Theorem  2.2.1  . 

For  fixed  telR^  and  W  >  0,  denote  by  the  2W-periodic 

extension  of  the  function  -W  <  u  £  W,  to  the  real  line.  Its 

Fourier  series  is  given  in  the  following  well  known  result. 


Lemma  2.2.1.  For  any  fixed  tcIR"'’  and  W  >  0 


2Tritu  _  V  „ 

%  ■  I  ^ 


r  W  “  sin  Tr(2Wt-n) 


Tr(2Wt-n) 


(a.e.  (u)) 


and  the  Fourier  series  converges  boundedly. 


Theorem  2.2.1.  (Brown, 1967) .  If  F6L^(1R”) ,  and  f(t)  = 

/  F(u)e^^^^^dp  (u) ,  tcIR”,  where  tu  =  t,u,+. . .+t  u  ,  and 
^  X  1  n  n 

dvi^(u)  =  duj^...du^,  then  for  each  telR^  and  W  >  0, 

”  f^l  ^n)  ”  7r(2Wt. -k.) 

\  ^  . 


where 


n  2TTit.u. 

=  n  ej.  ^  ^  ,  and 
j=l^ 


|f(t)  -  yt)|  i  2^!  |F|dy 
A(W) 
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where  A(W)  =  {ucIr”: 


|uj|  >  Wj  j=l,2, . . . ,n} • 
f(t)  =  lijn  . 

i*r  ” 


’ITius  for  each  tcIR^, 


If,  in  addition,  for  some  W  >  0,  F(u)  =  0  for  almost  all  uelR^  with 
lUjl  >  W,  j=l,2,...,n,  then  we  have  the  classical  sanpling  expansion 


f(t)  =  f^^(t)  . 


The  following  will  be  needed  in  stating  the  stochastic  process 
analogue  of  Theorem  (2.2.1).  Let  {x(t) ,  telR^}  be  a  second  order 
mean  square  continuous  stochastic  process  with  correlation  function 
R(t,s)  =  EIx(t)xCs'J  ] .  Assume  that  ReL^(IR^)  and  R^(*)  4  RCt,*)eL^(IR^) 
The  Fourier  transform  of  R  is  denoted  by 

R(u,v)  =  //  R(t,s)e  ,  u,V€]R^  . 

-00 

2 

Since  R  is  continuous  and  Lebesgue  integrable  on  IR  it  is  also 

2 

Riemann  integrable  on  ]R  ,  and  thus  the  quadratic  mean  integral 


y(u)  =  R  /  x(t)e'^’^^^“dt  ,  uelR^  , 


exists  and  defines  a  mean  square  continuous  stochastic  process  (since 

_  /N  11 

E[y(u)y(v)l  =  R(u,-v)is  continuous  in  both  u  and  v).  Since  R^cL  (IR  ) 
for  all  telR^,  its  Fourier  transform 


\(v)  =  /  R^(s)e*^^^®'^ds  ,  velR^  , 

is  well  defined  for  all  tcIR^.  In  fact,  R^(v)  =  E[x(t)y(-v)]  for  all 
t,veIR^,  and  since  both  x(t)  and  y(v)  are  mean  square  continuous,  then 


/ 
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R^(v)  is  continuous  in  both  t,v.  Now  we  also  assume  that  RcL^ClR^), 
and  R(* ,v)eL^(]R^)  for  all  velR^.  Since  R^(v)  is  continuous  in  both 
t  and  V,  it  follows  that 

8,(v)  =  /  RCu,v)e2”““du  , 

for  all  t,V€lR^.  Hence 

/  lR^(v)|dy;^(v)  ^  fj  |R(u,v)|dudv  <  »  , 

for  every  teIR  ,  i.e.  R^(v)  is  a  continuous  function  in  both  t,v,  and 
is  integrable  with  respect  to  v  for  every  telR^. 

Rgnark.  It  should  be  noted  that  if  ReL^CIR^)  and  R(t,s)  >  0  for 
all  t,S€lR^,  then  the  condition  R^cL^CIR^)  is  satisfied  for  all  telR^. 
Indeed,  the  two  conditions,  ReL^CIR^)  and  R  is  continuous  onlR^, 
imply  that  the  Rieraann  integral  R//R(t,s)  exists  and  is  finite.  It 
follows  that  the  Riemann  mean  integral  R/E[5*xCs)}ds  exists  and  is 
finite,  and 

E[^*R/x(s)ds]  =  R/E[C*x(s)Jds  . 

Taking  £;  =  x(t)  gives  that  for  each  tcIR^,  the  Riemann  integral 
R/R(t,s)ds  exists  and  is  finite.  Since  R(t,0  >  0  for  all  tcIR^, 
it  follows  that  the  integral  exists  as  a  Lebesgue  integral  as  well, 

i.e. 

/|R(t,s)|ds  <  ®  for  all  tclR^  . 

We  now  establish  the  analogue  of  Brown's  result  CTheorem  2.2.1) 
for  a  non-stationary  (non-bandlimited)  second  order  stochastic  process. 


■r'i’ 


Theorem  2.2.2.  Let  {x(t) ,  tclR^}  be  a  second  order  mean  square 
continuous  stochastic  process  with  correlation  function  R.  Assume 
that  ReL^(IR^),  R(t,«)eL^(IRb  for  all  tcIR^,  and  RcL^CIR^), 

R(* ,v)eL^(IR^)  for  all  velR^.  Then  for  each  fixed  tclR^  and  W  >  0, 


(2.2.1)  x^(t):  =  \  Tr(2Wt-n)  ^  ®W  y(u)du 


2Tritu 


where  the  equality  is  a.s.,  the  series  converges  in  quadratic  mean, 
and  y(u)  is  defined  by  the  quadratic  mean  integral 


y(u)  =  R/  e  ^’^^^^x(t)dt  ,  uelR^ 


Also  for  each  telR"*^  and  W  >  0,  the  error 


(2.2.2)  ej(t):  =  E|x(t) -x^(t)  ^  ^  4  /  /  lR(u,v)|du  dv  , 

(u(>W  (v(>W 

and  thus  for  each  telR^, 


(2.2.3) 


x(t)  =  lim  Xjj,(t) 


is  quadratic  mean.  If,  in  addition,  R(u,v)  =  0  for  almost  all 
|u| ,  |v|  >  W,  for  sane  W  >  0,  then  x(t)  =  Xy^(t) ,  which  is  the  classi¬ 
cal  sampling  theorem  for  non- stationary  bandlimited  processes. 

Proof.  Let  us  denote  already 

been  noted  that  the  quadratic  mean  integral  y(u)  defines  a  mean 
square  continuous  stochastic  process  with  correlation  function 
E[y(u),y(vj]  =  R(u,-v).  Also,  the  quadratic  mean  integral 
R/e^^^^“y(u)du  ,  tcIR^,  exists  since  the  integral 
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If  ejJ^’'^^E[y(u)yCv)]du  dv  , 

exists  (and  is  finite)  as  a  Rianann  and  as  a  Lebesgue  integral  (for 

''  2 
R(y»v)  is  continuous  and  Lebesgue  integrable  on  IR  ) .  Let 

e^(t;W):  =  E|  I  x(^)g^(t;W)  -  R/  ej''^^“y(u)du| ^ 
n=-N 

■  J  «  J 

n=-N  HF-N 

-  I  gn(t;W)  R/  ej;2^i^'^[x(^).y(u)]du 

n=-N 

N  - 

-  I  gn(t;W)  R/  ^  E[x(^)y(u)]  du 
n=-N 

(2.2.4)  +  E|R/  ej’'^^^(u)dul^  . 

We  notice  that 

m  4''“'V(u)du|Z  =  R//  e;,2’'“''g(u,-v)<lu  dv 

'  '//  R(u.v)  du  dv  . 

/\ 

Since  R  is  continuous  and  Lebesgue  integrable,  then  by  Theorem  (2.2.1) 

I  I  R(^.  e^^^^%^’^^^^R(u,v)du  dv  . 

n*-N  m=“N  N-x© 

/V 

Since  E  is  continuous  and  integrable,  we  have 
W 

I  gn(t:;W)R/  E[x(^)7(v) Jdv 

n=*N 

=  l  gn(t;W)/  ^(-v)dv 
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vt  -n 
N  TTl^  U 


*  //  [  I  e  "  R(u,v)du  dv 

n=-N 


^  ff  2iritu  ^2iritv  , 

—  JJ  ^  ®W  R(u,v)du  dv  , 

where  we  used  Lemma  (2.2.1)  and  the  dominated  convergence  theorem. 
Similarly  the  same  is  true  for  the  third  term  in  expression  (2.2.4), 
and  thus  e^(t;W)  -<■  0  as  N  ®  for  all  tcIR^,  W  >  0,  proving  (2.2.1). 


To  prove  (2.2.2),  we  have 

ej(t)  =  E|x(t)  -  R/  ej''^%(u)du|2 

=  R(t,t)  -  R/  e^^’^^^“E[x(t)y(u)]du 

-  R/ 


E[x(t)y(v)]dv 


(2.2.5) 


R//  R(u,-v)du  dv 


But 


R/  ej,^’““E[x(t)ytu)Idu  -  /  RjC-u)du 


-  //  4”^*“  R(u,v)du  dv  . 


and  similarly  for  the  third  term  in  (2.2.5).  Hence 


2iritu_2Tritv  _2Tritu_2ffitv  27ritu  2vitv 


rtf  tiritu 

e^(t)  =  //(e  e 


®W 


®W 


^  2lTitU  2lTitVv  n/  J 

+  e^^  )  R(u,v)du  dv 


(2.2.6)  =  ff  (e2^i^“  -  e^’^i^^)  (e^^i^^  -  ej’^i^^)  R(u,v)du  dv 

|u|,|v|>W  ^  ^ 

Now  the  inequality  i  2,  we  obtain 


^  O  9 

proving  (2.2.2),  and  (2.2.3)  follows  from  the  fact  that  ReL  (IR  ). 

□ 

Renark.  Theorem  2.2.2  holds  for  multiparameter  processes 
{x(t),  telR^},  n  s  1. 

Ronark.  The  bound  in  (2.2.2)  may  be  written  in  a  different 
form  as  follows.  From  (2.2.6)  we  have 

ej(t)  <  J/le  -  e^  {•\e  -  e^  | • |R(u,v) |du  dv 

CO 

=  4  ^  I  sin  2TTkWtl*|sin  2TrjWt|  •  |R(u,v)  |du  dv  . 

k,j=-'» 

The  term  k  =  0  =  j  is  always  zero,  so  that  only  the  integral  of  |R| 
over  the  ranaining  squares  enters  into  the  sum.  Also,  for  any  integer 
®  and  thus  x  ( 2^)  ~  * 

2.3.  The  Rate  of  Convergence  in  the  Finite  Sampling  Approximation 
for  Time-Limited  Stochastic  Processes. 

Butzer  and  Splettstbsser  (1977)  derived  a  sanpling  approximation 
for  time-limited  functions  which,  in  fact,  is  a  special  case  of 
Brown's  result  (Theorem  2.2.1),  and  determined  the  rate  of  convergence 
of  the  approximating  series  under  certain  conditions.  These  results 
are  summarized  in  the  following  theorem. 

Theorem  2.5.1.  (Butzer  arid  Splettstbsser,  1977) .  Let  f  be  a 
continuous  function  defined  on  ]R^  such  that,  for  scxne  (fixed)  T  >  0, 
f(t)  -  0  for  all  |tl  >  T  and  fcL^(F^).  Then 
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(2.3.1) 


NfW) 

f(t)  =  lim  I 

n=-N(W) 


sin  Tr(2Wt“n) 


,  tcIR^  , 


vdiere  N(W)  =  [ZWTJ,  the  largest  integer  less  than  or  equal  to  2WT. 
If,  in  addition,  f^^^eLip  a,  0  <  a  s  1  for  some  (fixed)  red, 2,...}, 
with  constaint  L^.,  then  for  W  >  -2— 


(2.3.2) 


(T+1)L^ 

2^'^(r+a-l) 


W 


,r+a-l 


teIR 


Here  Lip  a,  0  <  a  s  1,  is  the  Lipschitz  class  of  continuous 

functions  f  on  IR^  for  which  there  exists  a  constant  0  <  L  <  »  such 

that  sup  |f(t+h)-f(t)|  s  L|h|“  ,  helR^  . 
telR^ 

The  following  result  is  the  analogue  of  Theoran  (2.3.1)  for  second 

order  processes  which  are  not  necessarily  stationary.  First  we  intro- 

duce  some  notation.  Let  C(IR  )  be  the  class  of  all  continuous  functions 

on  IR^,  and  | |R| I  =  sup  |R(t,s)|.  Let  Lip^^^a,  ae(0,l],  be  the  class 
t,S€lRl 

2 

of  all  functions  RcC(lR  )  for  \diich  there  exists  a  constant  0  <  L  <  «» 
such  that 


l|Ah,gR||  ^  L|h|“|gr  ,  h,gdRl  , 


where  gR(t,s)  =  R(t+h,  s+g)  -  R(t+h,s)  -  R(t,s+g)  +  R(t,s).  The 
first  modulus  of  continuity  is  defined  by 


0)^(6, A;R)  =  sup{||A^^gR||:  |h|  s  6,  |g|  s  X} 
where  6  >  0,  X  >  0.  Similarly,  the  r-th  modulus  of  continuity  of  R,  r  is 
a  positive  integer,  is  defined  by 


I 
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a)j.(6,X;R)  -  supi  |  |Aj^gR|  | :  |h|i6,  |g|sA}, 

A?  _R(t,s)  -  I  I  (-l)^**(J)(r)R(t+kh,  s+4g)  . 

«l,g  Jj_Q  £sQ  K  X- 

It  should  be  noted  that  for  a€(0,l], 

Lip^^^a  »  {ReC(IR^):  0)^(6, X;R)  s  L6“x“;  6  >  0,  X  >  0}. 

Theorem  2.3.2.  Let  x  *  {x(t),  teF^}  be  a  second  order  mean-square 
continuous  stochastic  process  with  correlation  function  R  such  that, 
for  some  (fixed)  T  >  0,  R(t,t)  =  0  for  all  |t|  >  T  (time  limited 
process)  and  ReL^(IR^).  Then  for  all  teF^  and  W  >  0, 


e^(t):  =  E|x(t) 


(2.3.3)  54/  /  |R(u,v)|du  dv  , 

|u|,|vI>W 


and  thus 


(2.3.4) 


x(t)  =  lim 


f 


in  the  mean  square  sense,  where  N(W)  =  [2WT].  If,  in  addition,  for 
some  positive  integer  r  and  some  ae(0,l]. 


at  3s 


with  constant  L^.,  then  for  every  teF^  and  W  >  0  we  have 


(2.3.5)  e^d)  5  • 

Proof.  (2.3.3)  and  (2.3.4)  are  special  cases  of  (2.2.2)  and 
(2.2.3).  To  show  (2.3.5)  notice  that,  for  all  u,v  ^  0,  we  have 


/ 
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(-l)"*^(u,v)  ■  II  R(t  *  55,  s  *  ds  , 

and  thus  for  all  u,v  >  W, 

,2Cr+l); 


n=0  m=0 


T  r+1  r+1 


I  III 


T  T  *^“0  "'P'O 

■‘'  W  '^'2V 


n  ' '  m 


/  /  ,  R(t.s)}e-2^*'~‘'''Jdt  ds, 

25-  H 


which  yields  the  inequality 


2^^"'^^^lR(u,v)|  <  / 


/  ,R(t,s)|dtds 

-T-  Ir  -T-  ^  ^  ^ 


^  r-yr  ^  r+1-,2  ,1  1  .n^ 

^  (2T  +  ~^)  0)  ■,  (~  ,  -  ,R)  . 


since  -  e  Lip^^^a,  it  can  be  easily  shown  that,  for  any 

3^  3s 


>2r„ 


2W  “'r+l'-2n  »  2v 

el  r'>^ 

Now 

positive  integer  j , 

Vi('S.A;R)  <  6Vu).(6,A,  , 

J  J  3t  3s 

and  hence  for  all  u,v  >  W  , 

(2.3.6)  |R(u,v)|  <  (2T  +  ^ - i- 

^  (2u)^  “  (2v)’^ 


r+a 


From  (2.3.3)  and  (2.3.6)  we  have 


1 
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e^Ct)  1  4  /  /  |R(u,v)|du  dv 

^  |u|.|v|>W 


2-2(2r+a),  ^  f 


_  -)"2(2r+cx"l)|  ^ -v^  .  r+l\2  1  1 


—  ^  r7T  +  2  1 

■  22(zr~“-ir(,.„.i72  -Tfl’  TTFSTT 

proving  (2.3.5). 


□ 


Under  the  conditions  of  Theorem  2.3.2  the  approximating 
sequence  Xy^(t) ,  in  fact,  converges  to  xCt)  with  probability  one  for 
each  fixed  tflR^.  The  rate  of  convergence  is  given  in  the  following 
corollary. 


Corollary  2.3.1.  Let  x  be  as  in  Theorem  2.3.2  and  assume  that 
r  >  1  when  1/2  <  a  <  1  and  that  r  ^  2  vdien  0  <  a  s  1/2.  Then  for  a 
separable  version  of  x  and  each  tcIR^, 


(2.3.7)  WA  sup 

"  lif*.  i*r 


W>W^ 


rft^  Iff  ’^'1  ir(2Wt-n) 

^(t)  Z  .  .x(^)  — 


n=-N(W) 


0  a.s.  as  Wq-*-  «>, 


where  0  <  y  <  r+a  - 


Proof.  Consider  a  separable  version  of  x.  For  W  ^  1  put  W  = 


u 


and  for  each  fixed  telR^,  define  X^,  uc[0,l],  by 


'  x(t) 

,  ^i(^) 
u 


u  *  0 

0  <  u  s  1  , 


where  Xj(t)  -  x^Ct)  - 
u 


sin  ir(2Wt-n) 
n(2Wt-h)" 


.  Then  X  is  separable 


^ ^ 
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(in  u).  From  (2.3.S),  we  have 

where  C  =  (2T+l)\j.(r+a-l)'^  and  6  =  2(r+a)  -  3  >  0.  Thus, 

by  Kolmogorov's  theorem  (see  Neveu  (1965,  p.  97)), 

—  sup  lX«-X^,|  ■*■  0  a.s.  ash+O,  0<y<4, 
h^  0<u<h  ^  ^  ^ 

and  (2.3.7)  follows  by  putting  h  =  ry^  .  □ 

”o 


2.4.  Finite  Sampling  Approximations  for  Non-Bandlimited  Functions 
and  Stochastic  Processes. 

Theorem  2.2.1  (the  case  n  =  1)  states  that,  if  f  is  the  Fourier 
transform  of  an  L^(IR^) -function,  then  the  infinite  sum 


converges  to  f(t)  pointwise  everywhere  as  W  -►  «>.  It  is  of  practical 
interest  to  investigate  the  possibility  that  a  finite  sum  of  the 
form 


(2.4.1) 


N^W) 

n=-N(W) 


sin  Ti(2Wt-n) 
Tr(2Wt-n) 


f 


idiere  N(W)  is  a  positive  integer-valued  function  of  W  >  0,  would 
converge  to  f(t)  under  suitable  conditions  on  N(W)»  and  also  to 
determine  the  speed  of  convergence.  Such  a  result  is  obtained  in 
Theorem  2.4.3  ,  and  its  analogue  for  an  appropriate  modification 
of  the  finite  sum  (2.4.1)  is  obtained  in  Theorems  2.4.1  and  2.4.2^ 


and  then  extended  to  weakly  stationary,  hazmonizable,  and  certain 
stable  processes.  In  all  these  results  N(W)  is  required  to  tend  to 
infinity,  as  the  sanpling  rate  W  tends  to  infinity,  fast  enough  so 

thatNge.*-. 


Theorem  2.4.1.  If  f  is  the  Fourier  transform  of  a  f  inite 
signed  (or  conplex)  measure  m  on  the  Borel  sets  of  the  real  line. 


(2.4.2) 


f(t)  =  /  e^^^^^djj(u)  ,  telR^  , 


and  if  N(W)  is  a  positive  integer  valued  function  of  W  >  0  such  that 
oo  as  W  -*■  »,  then  for  each  tclR^  , 

N(W)  ,  , 

(2.4.3)  f(t)  =  lim  )  (1  -  Jilll — )ff— 1  Tr(2W-t-n) 

n=i(W)  ~(2w"t-f0  » 


and  the  convergence  is  uniform  on  compact  sets. 


Proof .  Consider  the  error 


■  nTcw)'^  ■  "^*5^ 


n=-N(W) 


.  n 

TTl  U  U 


sin  7r(2Wt-n) 
Tr(iWt-n) 


r  n  In!  ■ 


fi  !-!  1  ”  ff  “ 

■  N(W)+1^® 


(2.4.4) 


sin  •rr(2Wt-n) 

"7r(m-n) 


d|ul  (u) 
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_  I-”!  ZTTitu  1  ^  1  /  , 

■  /  1®  ■  NfW1+l  ^  ^  •'  ® 

.„,  I  Niwj+i  ZW_^ 


dly|  (u) 


=  / 


ZiTitu  1  f^j.2iTitV|.  1  y  27rin(  2^^) 

®  '  ZW  ■'  ®  Im(T^+i  II®  ]dv 


d|y|(u) 


Js- 


=  / 


Zuitu 


u 

ZW 


I  a2’'“(™='*“\(„Cx)dx|d|MUu) 

-k-Ji 


u 

ZW 


k- 


u 

ZW 


=  /  1-  /  e^^"'^^Kj^^„^(x)dx|d|y|(u) 

—oo  j  U 


_U 

2W 


where  K  rxl  =  ^  f  -2irinx  ^  J^.sin  tt(N11)x,Z  . 

wnere  k^i.xj  2n=-k  N+l^  sin  ttx  ^ 

Fejer  kernel.  Since  |y|(R^)  <  »  (see  Rudin  (1974),  p.  1Z6) ,  given 

e  >  0,  there  exists  an  a  =  a(E)e(0,«>)  such  that  if  A  =  [-a, a],  then 

I  y  I  (A^)  <  Y  .  Since  Kj^  s  0  is  periodic  with  period  1  and 

/*Kj^(x)dx  =  1,  (Z.4.4)  can  be  written  as 

(Z.4.5)  ey^it)  <  ZlyKA'^)  +  [y |  (A)Qj^(t,W)  <  e  +  |y  1  (lR^)QN(t,W) 


where 


Sj- 


(Z.4.6)  Qj^(t,W)  = 


sup 

lulsa 


u 

ZW 


1  - 

■’^'ZW 
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k-y  -H  H  H-y 
By  writing  /  ^  /  +  /  +  f  ,  (y  = 

-Jj-y  -^J.y  .1^  L 


pKjCt.W)  SI-  /  e 
I  -»5 


^  4TriWtx 


Kj^(^(x)dx 


(2.4.7) 


W 

u|  -u 

4w 

+  sup 

e 

lulsa 

k-i 

HllH 

2 

4W 

lu|  -u 

■~iir 

+  sup 

/ 

lulsa 

-k- 

|u|+U 

4TriWtx 


^(W)  Wdx 


4W 


4TiiWtx  „  -  , 


Let  us  denote  by  Ij^(t,W),  k  =  1,2,3,  the  three  terms  on  the  right 
hand  side  of  (2.4.7)  in  the  order  they  appear.  For  l2(t,W)  we  have 


l2(t,W)  s 


*  2W 

/ 

*  2W 


Kj^(W)(x)dx 


But  for  0  <  X  s  J5  ,  Kjj(x)  s  -  v,here  C(~  J-)  is  a  constant 

,  ^  v^(N+l)x'^  ^ 

(see  Zygmund  (1959) ,  p.  90)  and  thus  for  W  >  a 


l2(t,W)  s  -j 


2C  f  I  , 

, -  /  -y  dx 

ir  fN(W)+l]  j,  _a  x^ 

*  2W 


s  —  _  [•”]  ^ 

Tr^[N(W)+lJ  ^ 


■[N(W)+1] 

Now  for  using  the  fact  that  **Kj^(x)dx  =  y,  we  have 


Choosing  any  6(V0  such  that  0  <  6(W)  <  H  and  6(V0  ® 
obtain 

r  ^  ^ 

I^(t,W)  =  2|^  /  +  (1  -  cos  4TrWtx)Kj^^^(x)dx  . 

Since  for  all  x,  Kj^(x)  s  2N+1  (see  Zygmund  (1959,  p.  90),  then 
6(W) 

/  (1  -  cos  4TrWtx)Kjj^^^(x)dx  s  2[2N(W)+1]6(W)  -►  0  as  W 


J(W)'*  ‘  2»W»  -K^f^fxjdx 


^  T 

Tr^jNfW)+l]  6(W) 


^2  1 
/  sin  2T7Wtx  •  — 7  dx 


,_4cwiti_.  (Si!u:)2jy 

tt[N(W)+1]  2iTW|tl6(W)  y 


^  *N(WFT  °  as  W  -►  »  . 


Notice  that  this  is  the  only  bound  tdiich  depends  on  t  and  that  the 
dependence  is  linear  in  jt].  It  follows  that  for  W  >  a, 
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(2.4.8)  Q^(t,W)  s  ^ - +  2[2NCW)+1]6(W)  +  . 

^  Tr^[N(W)+l](W-a) 

and  thus  Q|^(t,W)  -*■  0  as  W  ->■  «>.  Hence,  for  each  fixed  t  and  e  >  0, 

we  have  by  (2.4.5)  that  lim  sup  ej^(t)  s  e  which  implies  that  ej^^(t)  -►  0 

W 

as  W  ->■  <»  .  It  is  clear  from  (2.4.8)  that  the  convergence  is  uniform 
on  contact  sets.  □ 


The  following  theorem  gives  a  more  concrete  bound  on  the  error 
committed  by  considering  only  a  finite  number  of  samples  in  reconstruc 
ting  a  function  which  has  the  representation  (2.4.2). 


Theoran  2.4.2.  Let  f,y,W,N(W),  and  ey^(t)  be  as  in  Theorem 
(2.4.1).  Then  for  an  arbitrary  (but  fixed)  W  >  1  and  every 
|t|  <  with  t  f  nclN  =  (0,  +  1,  +  2,...}  we  have 


(2.4.9)  e„(t)  <  2|yl(IRl)[It|  ^  isin  .?^Wtl  j  W  ^  2|y|{|u|>W-l}  . 

"  Tr(l-e  ’^)N(W) 

Proof.  Fix  W  >  1  and  ^  ^  »  neJJ .  From  (2.4.4)  we  have 

00 

(2.4.10)  e,^(t)  s  /  |Hj^  ^(t,u)ld|yl(u)  , 

«00  ^ 


where 


(2.4.11)  ® 


2TTitU 


NfW) 


n«-N(W) 


(1  ^  NiSrir)* 


nl  . 


sin  ■ir(2Wt-n) 

■  VCIWt-n)  • 

If  A(W)  =  [-W+1,  W-1] ,  then  the  inequality  (2.4.10)  may  be  written 


as 


/ 
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(2.4.12)  ej^(t)  s  (  /  +  /  )|H^^.(t,u)|d|yl(u)  . 

A^(W)  ’ 

By  (2.4.4)  we  notice  that  |H,y,  „(t,u)|  =  |l  -  ’ 

and  thus  |Hj^  ^^(t,u)|  s  2  for  all  tcK^,  ueK^,  N  ^  1,  and  W  >  0. 

From  (2.4.12)  we  obtain 


(2.4.13)  e^^(t)  <  /  |Hj^yt,u)|d|M|(u)  +  2|m1(A^(W)) 

A(W)  * 


<  |y|(]R^)Pj^(t,W)  +  2|y|(A^(W))  , 


where  P  (t,W)  =  sup  K  ,.(t,u)  |  . 
ueA(W) 

Now  consider  the  integral 


,2T7iuZ 


=  2^1  /  '  ^wf!T^rz^)sin  2TrWz  1^1  ^  ^ 

^,W 

vdiere  =  (zeC:  |z|  =  2^[N(W)+1]}  .  From  Cauchy’s  residue  theorem, 
we  have 


(2.4.14)  ,,_„(t.u)  -  (1  -  |i|L)  Ij 


2iritu 


N(W)+1'’  sin  2'iTWt 


n=-N(W)'"  N(W)+l\^  -t) 

and  thus  from  (2.4.11) 

"  i(W)il  +  sin  2TTWt  •  Ijj^yj(t,u)  ,  |t|  <  . 


Hence 


(2.4.15)  |Hj^yt,u)|  |sin2irWt|  •  |lj^yt,u)|.  \t\ 

Since  is  an  entire  function  of  exponential  type  2tt|u|,  then 

from  a  result  by  Piranashvili  (1967)  we  have  for  ucA(W)  that. 


w 


and  from  (2.4.15),  that  for  W  >  1 


‘nn;  ")[N(W)]‘'  >•" 

and  hence  for  W  >  1  and  /  1 1 1  <  , 


(2.4.16)  Pj^(t,W)  <  +  JWlsy..2.  Wt_j_^ 

^  Tr(l-e ’^)[N(W)]' 


Thus  from  (2.4.13),  we  obtain 


ej^(t)  <  2|Ml(Ilb[|tl  + 


for  W  >  1  and  |t|  < 


+  2|y|(A‘'(>0)  , 

(1-e  ’^)N(W) 


,  ncK  . 


Rgnark  2.4.1.  We  now  conment  on  the  two  bounds  obtained  in 
Theorems  2.4.1  and  2.4.2  .  From  (2.4.5)  and  (2.4.8)  in  the  proof  of 
Theorem  2.4.1  we  have, 

ej^(t)  <  2|ul{|u|>a}  +  2|M|(lRbl&}j|?5-+  - 

w  NW+i  ^^[N(w)+l](W-a) 


IN(W)+1]6(W)} 
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=  2lpl{|ul>a}  +  2lylCIR^){C|t|jj^^  +  ^  noS)^1  * W(W-a) 

.N,(^va^5(w)>^ 

=:  B^(t,W) 

for  all  W  >  a  and  telR^.  Fran  Theoran  G2 . 4 . 2)  we  have  that  for  each 
fixed  W  >  1  and  t  with  |t)  <  , 

ej^(t)  s  2lyl{lul>W-l}  2|yl  (1R^){  Itj  +  Jsinjrritf^j  W 
^  irCl-e  ^)N(W)  ^  ^ 

=:  B2(t,W)  . 

Tt^ 

In  the  bomd  C  could  be  taken  to  be and  6(W)  n>ay  be  chosen  as 
small  as  desirable  so  that  the  fourth  term  in  the  expression  of  B^^ 
may  be  omitted  (since  it  can  be  made  arbitrarily  smaller  than  the 
other  three  terms  by  an  appropriate  choice  of  6 (W) ) .  The  bound  B 
has  the  advantage  over  the  bound  B2  of  holding  for  all  tcIR^.  It 
should  be  noted  that  even  though  for  each  fixed  t,  Bj^(t,W)  0  as 
W  -►  «>  ,  for  t’s  large  relative  to  W,  namely  for  1^1  >  -^  — , 
the  bound  B^^  (through  its  second  term)  is  larger  than  |y|(IR^)  which 
is  an  upper  bound  on  |f(t)| .  Large  as  this  bound  on  the  error  may 
seem,  there  is  no  smaller  bound  available  for  such  t’s  and,  in  fact, 
it  seems  quite  likely  that  at  least  for  certain  t’s  the  approximation 
error  would  be  of  the  magnitude  of  |f(t) | .  The  bound  B2  holds  only 
on  the  interval  1 1  j  <  excluding  the  sample  points  (at  vtfiich 
we  know  anyway  that  the  approximation  error  ©^^(t)  vanishes).  However, 
it  has  the  following  advantages  over  the  bound  Bj^.  It  contains  one 
term  which  vanishes  at  the  sampling  points  and  is  thus  very  small  near 
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the  sampling  points;  thus  the  bound  B2  is  more  sensitive  than 
near  sanpling  points.  Also,  the  second  term  of  B2  is  always  smaller 
than  the  second  term  of  Bj,  and  putting  a  ■  W-1  to  equalize  the 
first  term  of  both  bounds,  it  is  easily  seen  that  the  third  term  of 
B2  is  always  smaller  than  the  third  term  of  Bj.  In  conclusion,  in 
the  restricted  region  idiere  it  holds  the  bound  B2  is  lower  and  more 
sensitive  to  the  location  of  the  sanpling  points  than  the  bound  Bj^, 
while,  of  course,  Bj^  provides  a  bound  even  where  Bj^  does  not  hold. 

A  typical  plot  of  the  two  bounds  for  fixed  W  >  1  (and  a  =  W-1) 
is  as  follows. 
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Under  further  conditions  a  function  of  the  form  (2.4.2)  can  be 
approximated  by  the  simpler  finite  sums  in  (2.4.1)  rather  than  those 
in  (2.4.3). 


Theorem  2.4.3.  Let  f  be  the  Fourier  transform  of  a  finite  signed 
(or  complex)  measure  p,  on  the  Borel  sets  of  the  real  line,  which 
satisfies 


00 

(2.4.17)  /  ()>(u)dlul  (u)  <®  , 

'OO 


where  (j)  is  a  symnetric  non -negative  function,  strictly  increasing  on 
(O,"),  and  such  that  Ku)  ->■  “  as  u  ^  <».  Let  N(W)  be  a  positive 
integer  valued  function  of  W  >  0.  Then  for  an  arbitrary  (but  fixed) 
W  >  1,  and  |t|  <  such  that  t  ji^  ,  nelN ,  we  have 


I  n 

ew(t)  «  f(t)  -  t  f(^) 
”  '  n=-N(W) 


sin  T7(2Wt-n) 
iT(2Wt-n) 


(2.4.18)  s  +  4|y  |  (IR^ 

'n'(l-e  ) 

where  *(1(10  =  /  (|)(u)d|y  ]  (u) .  If,  in  addition, 

lul>W-l 

(i)  "o  as  W  -*■  »,  and 

(ii)  N(W)  =  0(e^^  ^^)  for  seme  c  >  o  , 
then  for  all  tflR^,  B(t,W)  -*■  0  and  ej^(t)  0  as  W  ®. 
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Proof.  Fix  W  >  1  and  ^  ^  ,  nclN.  As  in  (2.4.4)  we  obtain 


Vt)  ^  /  K  wCt,u)ldly|(u) 

-CO  * 

=  (/  +  /  )|G,.  ^.(t,u)|dly|(u) 

AW  A"(w)  ’ 


where  A(W)  *  [-W+1,  W-l]  and 


(2.4.20)  Gj^^^^(t,u)  =  e 


2'iritu 


1T1  ^  u  TT(2Wt-n) 

■  „4cw)'  "f®*-") 


Also  as  in  the  proof  of  Theorem  (2.4.1),  we  notice  that 

»5-  ^ 

®  ^(W)W^ 


where  Il,(x)  =  Dirichlet  kernel. 

^n=-N  sin  TO 

jj 

is  an  even  periodic  function  with  period  1  and  /^lDj^(x)Idx  < 

1  +  £n  v[N+^]  (see  Kufner  and  Kadlec  (1971),  p.  230).  Then  for  all 


^  2W 


A^'CW) 


f  lGj^^j^(t,u)  |d|yl(u)  5  2/  |Iifj(^^(x)|dxj(t)(u)d|y|(u) 

W)  ’  A^(W)  ->5-2r 


(2.4.21) 


^  211+|n[^g0iy.  j  4,(u)d|y|(u)  . 


a''(w) 


f,  for  U€A(W)  and  |t|  <  ,  consider  the  integral 


2Triuz 


Ifj,j^(t,u)  =  ^  /  (z.t)si 


sin  2TrWz 


v4iere  Cjj  *  {zcC-*  |z|  =  ^  [N(W)+>s]}.  Proceeding  as  in  the  proof 
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of  Theorem  (2.4.2),  we  obtain 


|G^^^y(t,u)|  =  Isin  2TrWtl  • 

W  |,N^ 

7r(l-e  1N(W)  " 

^  ^  4  sin  2TrWt  W  li'l  ^  ^  N(W) 

^  -  ■■"'“-c —  iw  » isf  ^  It'  ^  -ir 


and  (2.4.8)  follows  from  (2.4,1)  and  (2.4.22).  It  is  clear  from 
conditions  (i)  and  (ii)  that  B(t,W)  ->■  0  as  W  «  for  all  telR^.  Now 
fix  tcIR^  and  let  W  ->  ».  Whenever  W  is  such  that  N(W)  >  2W|t|  and 
t  =  -2^  for  some  nelN,  then  we  clearly  have  ej^^(t)  =  0  from  its  very 
definition.  As  W  -►  »  along  any  other  values  (t  ^  ,  nelN),  then 

ey^(t)  s  B(t,W)  -►  0.  It  follows  that  ej^(t)  -►  0  as  W  -►  ».  □ 


Remark  2.4.2.  It  is  clear  that  the  approximation  of  f(t)  by  a 
finite  sum  of  the  form  (2.4.1)  is  a  much  more  delicate  problem  than 
its  approximation  by  the  modified  finite  sum  of  the  form  (2.4.3). 
Hence  the  additional  assumptions  on  the  function  f  required  in 
Theoron  2.4.3,  compared  with  Theorem  2.4.1.  As  in  Theorem  2.4.1, 
condition  (i)  of  Theorem  2.4.3  puts  a  lower  bound  on  the  growth  of 
N(W)  as  the  sampling  rate  tends  to  infinity.  Such  a  condition  is 
quite  natural  and  anticipated,  as  one  intuitively  expects  that  unless 
enough  terms  are  employed,  the  approximation  may  be  inadequate. 
Condition  (ii)  on  the  other  hand  puts  an  tpper  bound  on  the  growth 
of  N(W)  and  in  this  sense  it  may  seem  somewhat  counterintuitive. 
Condition  (ii)  could  be  improved,  i.e.  the  restriction  on  the  growth 
of  N(W)  could  be  weakened,  if  a  better  bound  than  that  used  in  the 
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proof  of  Theorem  2.4.3  could  be  found  for  the  function 

w 

„  C*  A  ZTlitU  1  r  2iritVn  ,-U-V^  J„ 

Gpj  -  e  ■  2W  ®  ®N(W)^  2W^^ 

as  a  function  of  W  for  fixed  t.ucIR^  (or  after  sane  algebra,  if  the 

TT 1 2 

rate  of  growth  of  |/  '  D  (x)dx|  as  u  -*•  «>  can  be  found,  instead  of 

the  rate  of  growth  of  /  '  ^lDy(x)  |dx  v4iich  is  used  in  the  proof  of 

0 

Theorem  2.4.3,  where  is  the  Kirichlet  kernel  (x)  =  • 

It  is  not  known  at  present  whether  some  restriction  on  the  growth 
of  N(W)  is  necessary  for  the  approximation  error  to  tend  to  zero  as 
W  -►  «>,  or  whether  this  result  holds  with  no  i?)per  limit  on  the  growth 
of  N(W)  as  one  may  intuitively  be  tanpted  to  expect,  and  condition 
(ii)  arises  only  because  of  the  specific  proof  used  here.  Also,  it 
is  not  known  at  present  whether  a  bound  similar  to  (see  Remark 
2.4.1)  holds,  in  this  case,  for  all  telR^. 


The  preceding  results  are  now  extended  to  weakly  stationary 
stochastic  processes  (Theoran  2.4.4),  harmonizable  processes 
(Theorem  2.4.5),  and  to  certain  stable  processes  (Theorem  2.4.6). 

Theorem  2.4.4.  If  x  =  {x(t),  tcIR^}  is  a  mean  square  continuous 
weakly  stationary  process,  and  if  N(W)  is  a  positive  integer-valued 
function  of  W  >  0  such  that  -►  <»  as  W  then  for  each  tcIR^ 


NfW) 

(2.4.23)  x(t)  =  lim  I  (1 

n=-N(W) 


ln|  .  f  n^  sin  ■iT(2Wt-n) 
^(M-n) 


where  the  convergence  is  in  the  mean  square  sense  uniformly  on  compact 
sets.  Furthermore,  for  any  fixed  W  >  1  and  |t|  <  such  that 

t  ^  ,  nc  IN ,  we  have 
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=  E 


^  / 


2TTitA 


n=-N(W) 

T 


Tri  S-X 


(2.4.27)  =  /I  -  / 


V-  X 

^  2W 


n=-N(W) 


(1  • 


du(X) 


-j,-A 
*  2W 


Since  this  expression  is  similar  to  (2.4.4),  (2.4.23)  follows  as  in 
the  proof  of  Theorem  2.4.1.  The  proofs  of  (2.4.24)  and  (2.4.25), 
(2.4.26)  are  similar  to  those  of  Theorems  2.4.2  and  2.4.3  respect¬ 
ively,  and  hence  they  are  omitted.  □ 

A  second  order  stochastic  process  x  =  {x(t),  telR^}  is  called  a 
harmonizable  process  if  its  correlation  function  R(t,s)  =  E[x(t)x(s)] 
is  of  the  form 

R(t,s)  =  J  I  e^^^^^'^"^^^dy(u,v)  ,  t,selR^  , 

-00  -oo 

2  2 

where  y  (the  spectral  measure  of  x)  is  a  complex  measure  on  (IR  ,B(]R  )). 

Theorem  2.4.5.  If  x  =  {x(t),  tflR^}  is  a  harmonizable  process, 
and  if  -►  <»  as  W  ->  <»,  then  for  each  tclR^  (2.4.23)  holds,  where 
the  convergence  is  in  the  mean  square  sense  uniformly  on  compact  sets. 
Furthermore,  under  the  conditions  of  Theorems  2.4.2  and  2.4.3, 
bounds  on  the  mean  square  error  similar  to  (2.4.24)  and  (2.4.25)  hold 
as  well  as  the  approximation  (2.4.26). 


Proof.  Consider  the  mean  square  error 


®W^t): 


/ 
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-  r  n  sin  T?(2Wt-n), 

=  [  [  ■  J . -  i7W?T^®  -uW-h)'-^J 


[e 


n=-N(W) 

-2.itv 


.  n 

/•I  l*^i  ^-  sin  ■n’(2Wt-n)  I j,.^,, 

„.^N(W)‘  '"(Sllt-n) 


k- 


u 

'2W 


^  /  /  1-  /  e‘'"«'“lC>,„,(u)du 


-*oo  -oo 


-wiL 
*  2W 


^N(W3 


*  2W 

,  f  4TriWtv  y  r^r'i^iir 
1  ■  /  e  ^N(W) 


V 

■2W 


d|y|(u,v)  . 


By  the  familiar  technique  used  in  the  proof  of  Theorem  2.4.1,  we 
have 

e^(t)  <  |p|(]R2)Q2(t,W)  +  41pI(aSa^)  , 

where  A  =  [-a,aj ,  a  >  0,  and  the  proof  is  conpleted  as  in  Theorems 
2.4.1  to  2.4.3.  □ 

We  finally  consider  certain  harmonizable,  but  non-stationary,  stable 
processes.  A  randan  variable  X  is  symmetric  a-stable  (SaS) ,  0  <  a  <  2, 
if  its  characteristic  function  is  of  the  form  E(e^^^)  =  exp(-bjj|t|°‘) 
for  some  positive  constant  b^.  A  stochastic  process  x  =  {x(t) ,  telR^} 
is  called  SaS,  if  every  finite  linear  combination  of  its  randan 
variables  is  SaS.  The  following  can  be  found  in  Shilder  (1970).  If 
X  is  a  SoS  random  variable,  then,  for  1  <  a  <  2,  the  map  X  |— >  b^^°^ 
defines  a  norm  on  a  linear  space  of  SaS  random  variables:  | |Xl |  =  bi^'*. 

If  the  process  {Z(X)):  X>0}  is  SoS  with  independent  increments,  then 
the  function  F  defined  on  [0,“)  by  F(X)  =  | |Z(X)| |®,  X  ^  0,  is  non- 


34 


/ 

i 


decreasing  and  thus  defines  a  Lebesgue-Stieltjes  measure  Vp  on 

the  Borel  sets  of  [O,®*).  If  the  family  of  functions  {f^C*)»  telR^} 
2 

belongs  to  L  (up) ,  then  the  integral 

x(t)  =  /  ft(A)dZ(X)  ,  t£lR^  , 

0 

defines  an  SoS  process  and  for  every  telR^, 

l|x(t)||“  =  nft(X)|“dyp(X)  . 

Theorem  2.4.6.  Let  a  stochastic  process  x  be  defined  by 

GO 

x(t)  =  /  cos  ZiitX  dZ(X)  ,  tcIR^  , 

0 

where  {Z(X),  X^O}  is  an  SaS  process  with  independent  increments  and 
finite  measure  Pp,  and  1  <  a  <  2.  If  “  as  W  -»•  «,  then  for 

every  telR^,  (2.4.23)  holds,  where  the  convergence  is  in  the 
1 1*1 1 -norm.  Furthermore,  under  the  conditions  of  Theorems  2.4.2 
and  2.4.3,  boimds  on  the  ||•|l^-norm  error  similar  to  (2.4.24) 
and  (2.4.25)  hold  as  well  as  the  approximation  given  in  (2.4.26). 


Proof.  Consider  the  a-mean  error 


«  NfW) 

e2(t):  =  ||x(t)  -  I  (1- 
"  n=-N(W) 


sin  ir(2Wt-n)  i 
Tr(2Wt-n)  ' 


a 

a 


cos  27TtX  - 


N^W) 

n=^N(W) 


sin  ■tr(2Wt-n) 
■TrC2Wt-n) - 


,  say  . 


As  in  (2.4.4),  we  have 


^  2TTt(2Vty+X)Kj^^^^(y)dy 

^  TW" 

=  Re[e^''“^  -  /  e2’“'™>'’^\p„(y)dy)  , 

-■^-JT 

and  the  proof  is  ccsnpleted  as  in  Theorems  2. 4.1  to  2.4.3.  □ 

The  same  results  hold  for  SoS  processes 

oo  oo 

x(t)  =  /  cos  2irtA  dZ,(X)  +  /  sin  2TrtX  d2,(X)  ,  telR^  , 

0  -^0 

where  Zj  and  Z2  are  independent  processes  as  in  Theorem  2.4.6. 

These  processes  are  the  SaS  (non -stationary)  analogues  (1  <  a  <  2) 
of  the  real  stationary  Gaussian  (a  =  2)  processes. 

2.5.  Sampling  Approximation  Using  Walsh  Functions. 

Recently,  Walsh  functions  have  been  increasingly  used  in  digital 
COTimunication  systems:  they  are  easily  generated  by  semiconductor 
devices,  their  pulse  shape  (1,-1)  conforms  with  operations  of  digital 
ccmiputers,  and  they  play,  for  discontinuous  signals,  the  role  conplex 
exponential  functions  (and  Fourier  transforms)  play  for  continuous 
signals.  In  addition,  they  have  been  used  in  experimental  sequency- 
multiplex  systems,  image  coding  and  enhancement,  general  two-dimension 
al  filtering,  etc. 

In  this  section,  using  Walsh  functions,  we  derive  a  sampling 
approximation  and  error  estimates  for  functions  which  are  not  necessar 
ily  continuous,  and  for  stochastic  processes  which  are  not  necessarily 
mean  square  continuous.  These  results  are  the  Walsh-analogues  for 
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W-continuous  functions  of  the  Fourier  results  of  Sections  2.2  and 

2.3  for  continuous  functions.  Results  similar  to  those  of  Section 

2.4  should  be  feasible  for  W-continuous  functions,  but  complete  proofs 
have  not  as  yet  been  obtained. 

The  following  notation  and  definitions  will  be  used  in  the 
sequel.  IR+  =  IN  is  the  set  of  all  integers,  is  the  set 

of  all  non-negative  integers,  and  is  the  set  of  all  non -negative 
dyadic  rationals.  Each  t  >  0  has  the  dyadic  expansion 

oo 

(2.5.1)  t  =  I  t.2'J  ,  t.e{0,l} 

j=-N(t)  J  J 

for  all  j,  where  N(t)  is  such  that  2^^^^  s  t  <  2^^^^^^,  and  we  put 
tj  =  0  for  j  <  -N(t).  If  teD^,  there  are  two  expansions  and  the 
finite  one  is  chosen  so  that  expansion  (2.5.1)  becomes  unique.  The 
componentwise  addition  modulo  2  (dyadic  addition)  of  t,se]R^  is  defined 
by  t  ®  s  =  l“,.Jt.-Sj|2'j. 

The  Walsh  functions  can  be  defined  in  several  ways.  The  following 
definition  is  based  on  the  system  of  Radanacher  functions  > 

te  [0,1),  where 

Ro(t)  - 

R^(t)  =  RQ(2'^t)  ,  n  s  1  , 

2ind  by 

TTit  . 

Rj^(t)  =  e  ^  ,  nclN^  ,  tc[0,l)  . 

The  set  of  Walsh  functions  is  defined  for  each 

non-negative  integer  n  =  Zn=.N(n)"j^  by 

N(n)  n  .  N(n)+1 

'Pn(t)  =  n  (R.  (t))  'J  »  expfmi  I  n,  .tJ  , 
j=l  •'  j=l  J 


(2.5.2) 


2 

and  is  orthonormal  and  complete  in  L  [0,1).  The  Walsh  functions  are 
extended  to 

N(u)+1 

=  'i^u(t)  =  exp{Tii  I  Uj  -t.},  t,uelR  , 

^  “  j=-N(t)  ^  ^  ^ 

and  they  have  the  property  that,  for  all  ueIR_^,  whenever  t  •  s  ^  D^, 

A  function  f  on  ]R^  is  called  W-continuous  if  f  is  continuous  on 
]R^\D^  and  right  continuous  on  D^.  It  is  clear  that  the  Walsh  func¬ 
tions  are  W-continuous.  If  feL^ClR,^,),  then  the  Walsh-Fourier  transform 
(WFT)  f''^  of  f  is  defined  by 

oo 

(2.5.3)  f*^(u)  =  /  f(t)U;  ft)dt  ,  U£lR^  , 

and  f'^'^  is  bounded  and  W-continuous.  If  f,  f**^ eL^(IR^)  and  f  is  W- 
continuous,  then  the  WFT  can  be  inverted  to  give 

OO 

(2.5.4)  f(t)  =  /  £"^(0)1)^  (u)du  ,  teIR  . 

0  ^ 

(See  Butzer  and  Splettstosser,  1978.)  The  Walsh  modulus  of  continuity 
of  a  function  feL^(]R^)  is  defined  by 

a)(f;6)  =  stqj  ||f(*)  -  f(*®h)|l  ,  ,  ,  6  >  0  , 

0sh<6  L^(IR^) 


For  a  >  0  and  a  constant  L  >  0,  the  Lipschitz  class  Lipj^a  is  defined 
by 

Lip^a  =  {f€L^(]R^):  a»(f;6)  s  L6“  ,  6  >  0)  . 

A  function  f€L^(lR^)  is  said  to  be  dyadic  differentiable  if  there 
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exists  a  geL^(IR^)  such  that 

in  •  -T  1 

lm\\k  I  2^[f(-)  -  f(.®2  -  g(Oll  .  =  0  , 

m>»  j=-m  L  (IR^3 

g  is  called  the  first  strong  dyadic  derivative  of  f,  and  is  denoted 
by  For  r  >  1,  D^^^f  is  defined  iteratively  by  D^^^f  = 

dII]  .  If  f  and  belong  to  L^(]R^),  there  exists  a 

constant  M  such  that  to(f;6)  ^  M6’^w(D^^^f  ;6) ,  6  >  0. 

A  complex  function  f  on  IR^  of  the  form 

2n 

(2.5.5)  f(t)  =  /  F(u)il)  (u)du  ,  telR. 

0 

for  some  ncIN  and  some  FeL^(0,2’^),  is  called  sequency  limited 
to  2^.  A  sequency  limited  function  f  which  is  W-continuous  and  in 
L^(IR^)  has  a  sampling  expansion  of  the  form: 

(2.5.6)  f(t)  =  I  f(-^)J(l;  2Vk)  ,  telR^  , 

k=0  2" 

where  J(v;t)  =  /%^(u)du,  t,V€]R  (Fine,  1950).  As  it  was  pointed  out 
0 

by  Kak  (1970)  and  Butzer  and  Splettstosser  (1978) , 


J(l;2\ek)  =  1 


[2 A,  2'"(k+l)) 


(t)  , 


and  thus  (under  the  stated  conditions)  the  functions  that  are  sequency 
limited  to  2^  are  precisely  the  functions  that  are  constant  on  each 
interval  [2  *^k,  2  ’^(k+1)),  a  rather  small  class  (unlike  the  class  of 
bandlimited  fuictions) . 

A  (dyadic)  saiipling  approximation  for  time-limited  functions 
(which  are  not  necessarily  continuous)  was  derived  by  Butzer  and 
Splettstosser  (1978): 


Theorem  2.5.1.  (Butzer  and  Splettstosser,  1978).  Let  f  be  a 
W-continuous  function  on  IR_j_  such  that  £(t)  =  0  for  all  t  s  T,  for 
sane  T  >  0,  and  f  .  Then 

N(n)  . 

(2.5.7)  £(t)  =  lim  I  £(^)1  _  _  (t)  ,  tclR^ 

irx»  k=0  r  [2  ”(k+l)) 

where  N(n)  =  .  If,  in  addition,  either  (i)  D^^^f  exists  and 

frl 

D*^  ^fcLipj^^  or  (ii)  £cLipj^(a+r) ,  for  some  fixed  a  >  0  and  rell,2,...}. 


(2.5.8)  sup  f(t)  -  I  f(-|)l  -n,  -n  ^  ^  • 

telR.  k=0  2”  [2  "k,2  (k+1))  ^  ^ 


We  now  derive  a  sampling  approximation  as  well  as  error  estimates 
for  functions  which  are  the  WFT  of  finite  (or  complex)  measures  and 
thus  not  necessarily  time- limited  nor  sequency  limited. 

Theorem  2.5.2.  If  £  is  the  WFT  of  a  finite  (or  con^lex)  measure 
y  on  the  Borel  sets  of  IR^,  i.e. 

00 

f(t)  =  /  I^^(u)dy(u)  ,  tcIR 
0  ^ 

then  for  every  tcIR^  and  nelN, 

(2.S.9)  f  (t)  .  1  -n  Ct)  -  /"♦t'‘'(u)du(u)  , 

"  k=0  2^  [2"k,2  ”(k+l))  0  ^ 

where  for  each  (fixed)  telR^,  ij/^”^(u)  is  the  z’^-periodic  extension 
of  the  function  i^^(u),  0  s  u  <  z’'  to  and 


(2.5.10) 


|f(t)  -  yt)|  s  2|y|[2V)  . 


Tbus  for  each  tcIR^, 
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(2.5.11)  f(t)  =  lim  f  (t)  . 

If,  in  addition,  y  is  absolutely  continuous  with  respect  to  Lebesgue 
measure,  and  feLipj^Ca+r)  for  some  a  >  0,  L  >  0,  and  red, 2,...}, 
then  for  every  telR^ 

(2.5.12)  |f(t)  -  f  (t)|  s 

n*-  ''  I  r+a-1 

Proof.  Since  4'{"^€l1[0,2")  is  periodic  with  period  2^",  W-contin- 
uous,  and  of  bounded  variation  on  [0,2^'),  then  the  partial  sums  of  its 
Walsh  Fourier  series  converge  everywhere  to  (see  Chrestenson, 
1955,  Theorem  2),  i.e.  for  each  telR^ 

(2.5.13)  4'^'^^(u)  =  i  a  ,  (t)ii;,  (2‘"u)  ,  ueIR 

k=0  n,Jc  k  '  + 

vdiere 

2^ 

(v)i^,  (2'\)dv 

1 

=  /  ’l't(2”v)i{),  (v)dv 
0  ^ 

1 

=  /  >l^v(2"t)./>^(k)dv 
1 

0  ^ 

=  J(l;2"t  «  k) 

“  1  ftl 

[2-''k,2‘"(k+l))  ^  ' 


Let 
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f  (t-n)  =  I  I  n  n  W  ■  /  4^^Cu)dy(u)l 

k=0  2^  [2A,2'"(k+l))  0 


Using  (2.5.13)  and  the  fact  that  for  each  nelN  and  telR^, 


(t)ldtvil(u) 


for  all  uelR^  and  K  >  1,  it  follows  that 

e  (t;n)  ->0  as  K  for  each  telR^  and  nclN  , 

K 

proving  (2.5.9).  Now 


lf(t)  -  f„(t)l=  l/\(u)dy(u)  -  /  4<["^(u)dy(u)! 


<  /  |ii)^(u)  -  (u)  Idly]  (u) 

2*^ 

s  2lyt[2'',<«>)  . 


hence  (2.5.10)  and  (2.5.11).  To  prove  (2.5.12),  notice  that  if 

=  F(u)  and  feLip,  (r+a) ,  then 
at  ^ 

(2.S.14)  lF(u)l  ^  L  2’^*“  ^  u  >  0  , 

(see,  Botzer  and  Splettstrdsser  (1978)).  From  (2.5.10)  and  (2.5.14) 


if(t)  -  c„(t)i  s  1 

L  ,-n(r+a-l) 

=  (r+a-ir 


we  have 


y 
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We  end  this  section  by  extending  the  results  in  Theorm  2.5.2 

to  stochastic  processes  which  are  not  necessarily  continuous.  We 

2 

first  introduce  the  following  notation.  A  function  R  on  = 

2  2 

[0,‘»)x[0,«')  is  called  W2 -continuous,  if  R  is  continuous  on 

2 

and  continuous  from  above  on  (in  the  sense  of  Neuhaus,  1971).  If 
1  2 

ReL  (IR^) ,  the  first  modulus  of  continuity  is  defined  by 


(*)(6,A;R)  =  sup{|  1A.  R|1  ,  ,  ,  0<h<6,  Osg<X},  6,X>0, 

*^'2  L^(]Rp 

where  Ah,gR(t,s)  =  R(t®h,  s®g)  -  R(t®h,s)  -  R(t,  s®g)  +  R(t,s),  Also 
121 

the  class  Lip^  '^a  is  defined  by 

Lip^^^a  =  (ReL^Cmf):  a)(6,A;R)  <  LfiV  ,  6  >  0,  X  >  0}  . 

The  WFT  of  a  function  ReL^CIR^)  is  defined  by 

W  00  00 

r”(u,v)  =  /  /  R(t,s)tl;  (t)ij;  (s)dt  ds  ,  u.velR  . 

0  0 

W  1  2 

Finally,  if  R  is  W2-continuous  and  R,R  cL  (IR^),  then  (as  in  (2.5.4) 

00  00 

(2.5.15)  R(t,s)  =  /  /  R”(u,v)iJ;^(u)ti(.  (v)du  dv  ,  t,se]R  . 

0  0 


Theorem  2.5.3.  Let  {x(t),  telR^}  be  a  second  order  stochastic 
process  with  correlation  function  R.  Assume  that  R  is  W2 -continuous, 
R,R’^eL^(]Rf),  R(t,-)  L^(IR^)  for  all  telR^,  and  r'^(‘ ,v)€L^(IR^)  for 
all  velR^.  Then  for  each  telR^  nelN 


(2.5.16) 


x„(t) 


=  y  x(— )i 

k=0  2*^  [2'\,2''^(k+l)) 


(t) 


R/ 

0 


(u)y(u)du 


where  the  equality  is  a.s.,  the  series  converges  in  quadratic  mean, 
and  y  is  defined  by  the  quadratic  mean  integral 
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y(u)  =  R/  4)^(t)x(t)dt  ,  uelR^  . 

Also,  for  each  telR^  and  neIN, 

m  00 

(2.5.17)  e^(t):  »  E|xCt)-x  (t)|^  ^  4  /  /  |R"(u,v)|du  dv  , 

2"  2" 

and  thus  for  each  telR^ 

(2.5.18)  x(t)  =  lim  x^^Ct) 

n-H» 

(2) 

is  quadratic  mean.  If,  in  addition,  ReLip^  (r+a) ,  for  some  a  >  0 
and  re { 1 , 2 , . . . ) ,  then 


(2.5.19) 


e^(t)  . 


^  L  2'2n(r+a-l) 


(r+a-1)' 


Proof.  The  proofs  of  (2.5.16),  (2.5.17),  and  (2.5.18)  are 
similar  to  those  in  Theorem  2.2.2  and  hence  omitted.  To  show 
(2.5.19),  notice  that  for  any  u  >  0  we  have  the  dyadic  expansions 


u  *  'l  U.2  ^  ,  u'^  =  I  (u'^) .  2~^ 

j=-N(u)  ^  j*N(u)+l 


and  thus 

-1  -1 
i|/  (u  )  =  exp{7ri  I  (u  )  u.)  =  -1  , 

“  j=-N(u)  J  J 

(see  Butzer  and  Splettstdsser,  1978,  p.  102).  From  (2.5.15),  we 
have  that  for  any  u  >  0 

r'^(u,v)  =  -  /  /  R(t,s)tl;^.(t®u’b'l'v(s)‘^^  ^ 

0  0 


=  -  /  /  R(t®u’^,s)i|;  (t)i|;  (s)dt  ds  ,  velR 
0  0  u  V 


Similarly  for  any  v  >  0 


«  Up 


44 


00  00 

R^^Cu.v)  =  -  /  /  R(t,s»v*^)ij<  (s)dt  ds  ,  ue]R 
0  0  u  V 


and  lor  u,v  >  0 


r"{u,v)  *  /  /  R(t»u'\  s»v'^)i|(  (s)dt  ds 
0  0 

Hence  for  u,v  >  0 

00  00 

r'^(u,v)  =  j  f  f  [R(t«u’^,  s«v‘^)  -  R(t®u'^,s) 


-  R(t,s»v  )  +  R(t,s)]i/^y(t)ii^y(s)dt  ds 


|rV.v)|s  ia,(2u'\2v-l;R)  s  ^  ,  u.v  >  0  . 

Now  fran  (2.5.17)  we  have 

e^(t)  .  L  r;;f)s  du)'  .  2-2n(r.a-l)  ^  ^ 

The  following  corollary  shows  that  the  approximating  sequence 
Xj^(t)  converges  to  x(t)  with  probability  one  for  each  telR^,  and 
gives  the  rate  of  convergence. 


Corollary  2.5.1.  Let  x  be  as  in  Theorem  (2.5.3)  and  assume  that 
r  +  a  >  2.  Then  for  each  telR^, 


(2.5.20)  2  ^  sup  |x(t) -Xj^(t)  I  -►  0  a.s.  as  Uq  -►  <»  , 

n>no 

r+n 

where  0  <  y  <  — 2 —  f- 


Proof.  For  each  fixed  t,  define  0  s  u  s  1,  by 


x(t)  for  u  =  0 


,  n  k  1, 


where  x„(t)  =  -n  -n  ^  separable 

•n  K-0  2*^  [2  \,2  ''(k+D) 

in  u  and  from  (2.5.19),  we  have  (with  n  such  that  2  <  u  s  2 

EIXq-X^I^  =  E|x(t)-x^(t)|^  <  C(2'^’')^‘"^  <  Cu^*^  ,  u  >  0  , 

,  22(.T*ct) 

where  C  =  =-= - ^  and  3  =  r+a-2  >  0  .  Thus,  by  Kolmogorov's 

(r+a-1) 

theorem  (Neveu,  1965,  p.  97), 


sup 

^  0<-^h 
22n 


x(t)-x„(t)l  =  4  ^  °  as  h  +  0  , 

^  h^  0<u<h  ^  ^ 


and  (2.5.20)  follows  by  putting  h  =  2  ,  -►  «>  . 


CHAPTER  III 


Sampling  Expansions  for  Operators  Acting  on 
Certain  Classes  of  Functions  and  Processes 


3.1.  Introduction. 

In  this  chapter  the  problan  of  reconstructing  bounded  linear 
operators  acting  on  classes  of  functions  bandlimited  in  the  sense 
of  Zakai  (1965)  and  of  Lee  (1976a)  will  be  considered.  Sampling 
expansions  for  bounded  linear  operators  acting  on  classes  of  func¬ 
tions  with  wandering  spectra  will  also  be  investigated. 

Recall  that  a  function  of  the  fom  f(t)  =  e2''^^“?(u)du  , 

-^0 

^  2 

where  Wq  >  0  and  feL  ['WqjWq]  is  called  conventionally  bandlimited 

to  Wg.  The  class  of  all  such  functions  will  be  denoted  by  BgOitfg) 

2  1 

and  is  a  Hilbert  subspace  of  L  (IR  ).  Every  feBQ(WQ)  has  the  follow¬ 
ing  sampling  expansion  and  convolution  representation 


/ 
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than  Bq{Wq) .  It  is  thus  interesting  to  notice  that  lAen  W  >  Wq 

the  partial  sums  of  the  series  in  (3.1.1)  belong  to  Bg(¥)  and  yet 
2  1 

its  pointwise(or  L  (]R  ))  limit  belongs  to  the  smaller  subspace 
BgCWg).  Of  course,  when  W  =  Wg,  (3.1.1)  is  the  expansion  of  f 
in  terms  of  the  basis  ^ 

Zakai  (1965)  extended  the  classical  concept  of  conventional 
bandlimitedness  to  a  broader  class  in  which  the  functions  need  not  be 
square  integrable.  He  also  proved  that  if  feBg(Wg)  and  W  >  Wg,  then 

oo 

(3.1.2)  I  (-l)''f(^)  =  0  , 

n=-oo 

u 

and  if,  in  addition,  f(u)(l  -  e  0)  belongs  to  L'‘'[-Wg,Wg] ,  then 
(3.1.2)  is  also  valid  for  W  =  Wg. 


3.2.  The  Band! imi ted  Case. 

Kramer  (1973)  derived  a  sampling  expansion  for  bounded  linear 
operators  acting  on  conventionally  bandlimited  functions,  and  Mugler 
(1976)  derived  a  convolution  representation  for  such  operators. 


Theorem  3.2.1.  (Kramer  (1973)  and  Mugler  (1976)).  If  T  is  a 
bounded  linear  operator  on  Bg(Wg),  then  for  every  feBg(Wg) 

»  sin  Tr(2Wg(*)-n) 

[Tf](t)=  I  f(^)  T[-^™?P^](t) 


n=-<»  ^"0 


(3.2.1) 


“  sin  2iTWf,(*-u)  . 

=  i  2.wl--u)  • 


When  T  is  time  invariant,  i.e.  [Tf(*-a)](t)  =  [Tf](t-a), 


(3.2.1)  takes  the  simpler  form 
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sin  2-n 


~  sin  2'rrW„(*)  - 

=  /  f(t-u)  - ^](u)du  ,  tcIR^ 

-oo  Q 


The  significance  of  Kramer's  expansion  is  that  Tf  may  be  re¬ 
constructed  from  samples  of  f  itself  rather  than  from  samples  of 
Tf.  For  instance,  the  differentiation  operator  [Df](t)  =  ^  f(t) 
is  a  time  invariant  bounded  linear  operator  on  Bq(Wq),  hence  from 
(3.2.1)  we  have 


f’(t)  =  I 

n=-oo 


„  ,  sin  Tr(2W„t-n) 

^^2WQMt  ^  TT(2WQt-nj  J 


Kramer's  sampling  expansion  (3.2.1)  will  be  generalized  to 

broader  classes  of  functions.  The  following  notation  will  be  used 

2 

in  the  sequel,  -or  a  non-negative  integer  k,  L  (Uj^)  is  the  class  of 
all  complex  valued  functions  defined  on  ]R^  that  are  square  integrable 
with  respect  to  the  measure  du,  (t)  =  - s-t-  .  If  feL'^Cp^) »  then  f 

k  (i+t'^)‘« 

defines  a  tempered  distribution  (denoted  also  by  f)  on  the  class  S 
of  rapidly  decreasing  functions  by 


f(e)  =  /  f(t)0(t)dt  ,  0£S  . 

'-oo 

(See  Chapter  4  for  relevant  definitions.)  The  distributional  Fourier 
transform  of  f  is  the  tempered  distribution  f  defined  by  f(0)  =  f(0), 

A 

0eS.  The  spectrum  of  f  is  the  support  of  f.  For  k  =  0,1,2,...  and 

2 

is  the  class  of  all  continuous  functions  fcL  (pj^) 

whose  (distributional)  spectrum  is  contained  in  [-Wq,Wq],  amd  is 

2 

called  the  class  of  Wp-bandlimited  functions  in  L  (Pj^) •  It  is  clear 


/ 
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2  1 

that  Bq(Wq)  is  the  class  of  WQ-bandlimited  functions  in  L  (IR  ),  and 
Bj^(Wq)cBj,^j^(Wq)  .  Also,  Bq(Wq)  is  dense  in  Bj^(Wq)  for  every  positive 
integer  k  (see  Lee,  1976b). 

Zakai  (1965)  obtained  a  sampling  representation  for  functions 
in  Bj(Wq).  Cambanis  and  Masry  characterized  Zakai 's  class  B2^(Wq) 
and  as  a  consequence  sharpened  Zakai 's  sampling  expansion  (see 
also  Piranashvili  (1967)  and  Lee  (1976a)). 

Theorem  3.2.2.  (Zakai  (1965),  and  Cambanis  and  Masry  ri976)). 
If  feB^(WQ)  and  W  >  Wq,  then 


and  the  series  converges  uniformly  on  compact  sets. 

Thus,  functions  in  Bj(Wq)  are  reconstructed  frcan  their  sanples 
using  functions  in  Bq(W),  W  >  Wq. 

Remark  3.2.1.  It  should  be  noted  that  (3.2.2)  holds  for 
W  =  Wq  if  the  Fourier  transform  g  of  g(t)  s  [f(t)-f(0)]t’^  is 

Tri  — 

such  that  g(u)(l  +  e  '^^)  ^  belongs  to  L^[-Wq,Wq]. 

Lee  (1977)  proved  an  analogue  of  TheorCTi  3.2.2  for  functions 

f£Bj^(WQ),  k  >  0. 

Theorem  3.2.3.  (Lee,  1977).  If  f€Bj^(WQ),  W  >  Wq,  0  <  B  <  W-Wq, 
and  I/;  is  an  arbitrary  but  fixed  c“- function  with  support  in  [-1,1] 

oo 

and  /  (j;(t)dt  =  1,  then 


>oo 


/ 
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(3.2.3)  f(t)  =  I  f(^)  » 

n=-oo  ■' 

and  the  series  converges  uniformly  on  compact  sets. 

It  should  be  pointed  out  that  the  function  i?(6(*)) 

belongs  to  Bq(W+3),  W  >  Wq.  Thus  functions  in  Bj^(Wq)  are  reconstruc¬ 
ted  from  their  samples  using  functions  in  Bq(W+3) ,  W  >  Wq  and 

0  <  3  <  W-Wq.  It  should  also  be  noted  that  the  presence  of  the 

/\ 

(damping)  factor  ip  in  (3.2.3)  cannot  be  eliminated,  as  (3.2.3)  is 
not  valid  for  feBj^.  k  >  2.  As  a  counter  exanple  consider 
f(t)  =  t(fcB2(WQ));  then  f(-^)  =  ^  and  the  series  in  (3.2.2)  does 
not  converge. 

Campbell  (1968)  derived  sampling  expansions  for  the  Fourier 
transforms  (as  functions)  of  tempered  distributions  with  compact 
supports.  If  a  tempered  distribution  F  has  a  compact  support  and 

2*TT-j  f’ll  00  1 

®  defined,  since  e^cC  for  all  uclR 

In  this  case  the  Fourier  transform  ^  of  F  may  be  thought  of  as  a  func 
tion  defined  on  IR^  by  F(u)  =  F(e^) ,  uelR^  (see  Section  4.2). 

Theorem  3.2.4.  (Can^jbell,  1968).  Let  F  be  a  tempered  distribu¬ 
tion  with  compact  support  and  with  Fourier  transform  f  as  a  function 
on  ]R^,  i.e.  f(t)  =  F(e^),  tcIR^.  Let  ij/  be  a  test  function  such 
that  i/;(u)  =  1  on  some  open  set  containing  supp(F) ,  and  let  W  >  0  be 
such  that  the  translates  {supp(i^)  +  2nW}^^Q  are  disjoint  from  sipp(F) 
Then 

oo 

f(t)  =  I  f(^)K(t  -  ^)  , 
n* 


(3.2.4) 


where  K(t)  =  ^  ,  and  the  series  converges  for  every 

tcIR^. 

Canqabell's  result  does  not  require  the  si^port  of  F  to  be 
synmetric  with  respect  to  the  origin  and  is  more  general  than  Lee's 
(Theorem  3.2.3)  as  functions  in  Bj^(Wq)  have  (distributional)  Fourier 
transform  with  canpact  support  in  [-Wq,Wq].  Campbell  considered  also 
a  sanpling  expansion  similar  to  (3.2.3)  when  supp(F)c(-Wq,Wq) , 

Wq  >  0,  (for  specific  ip)  and  derived  an  iqjper  bound  for  the  trunca¬ 
tion  error  which  was  recently  made  more  explicit  by  Lee  (1979) . 

To  establish  notation,  let  ip  be  a  fixed  but  arbitrary  function 

A 

in  S  whose  Fourier  transform  ip  satisfies  the  conditions 

(i)  ip  is  a  synmetric  test  function  supported  by  [-Wq-6,Wq+6]  , 

0  <  6  <  Wq, 

(ii)  ip(t)  =  1  for  all  te[-WQ,WQ], 

(iii)  ip(t)  <  1  for  all  U[-Wq,Wq]  . 

2  00 
Then  for  all  feL  (y^^) ,  the  convolution  f*ip  exists  and  is  a  C  -function 

in  L^(yj^).  If  fcBj^(WQ) ,  then 

f(t)  =  (f*ip)(t)  ,  telR^  , 

(see  Lee  (1976a),  also  Cambanis  and  Masry  (1976)).  The  following 
characterization  of  will  be  needed. 

2 

Lenma  3.2.1.  (Lee,  1976b).  If  fcL  (pj^)  is  continuous,  then 
the  following  are  equivalent. 


(a)  f(t)  =  (f*4')(t)  ,  U1r\ 


k-1  k 

(b)  f(t)  =  J  t-^  +  \g(t)  ,  tcIR^,  and  some  geB^CWQ), 

jo  ^0 

(c)  the  spectnm  of  f  is  contained  in  [-Wq,Wq]  , 

(d)  f  has  an  extension  to  an  entire  function  satisfying 

,  2TrW-|linz| 

lf(z)l  <  Cj^(l+|zl)  e  ,  zcC  and  some  Cj^  >  0. 

The  following  result  is  a  generalization  of  Kramer's  sanpling 
expansion  (3.2.1),  in  the  sense  that  (3.2.1)  is  established  for  band- 
limited  functions  feB^(WQ)  (3Bq(Wq)),  as  well  as  of  Zakai's  sanpling 
expansion  (3.2.2). 

Theorem  3.2.5.  Let  f€Bj(WQ)  and  W  >  Wq.  Then  for  any  bounded 
linear  operator  T  on  Bj^(W) 

OD 

(3.2.5)  [Tf](t)  =  I  f(^)[T<|.^](t)  ,  um^  , 

n=-a> 

where  <})jj(t;W)  =  ^^(2Wt^)  series  converges  in  L^(yj^) 

and  also  uniformly  on  con^jact  sets. 

Proof.  Fix  feBj(Wg)  and  W  >  Wq.  We  first  show  that  the  converg- 
2 

ence  in  (3.2.2)  is  in  L  (uj^)  as  well.  Frcrni  (b)  of  Lonma  (3.2.1)  we 
have  that  f(t)  =  f(0)  +  tg(t)  for  all  tcIR^,  and  some  g€Bg(Wg); 
hence  by  (3.1.1)  we  have 


0  =  /|g(t)  -  I  g(^)(t.n(t;W)l2dt 


n=-  00 


£’(0)vt;w)  - 


f(w)-£C0) 


(|)^(t;W)rdt 


(3.2.6)  2  /|f(t)-f(O)-f'(O)0Q(t;W) 


2Wt[f(^)-f(0)] 


mr(2Wt-n) 


sin  Tr(2Wt-n) 
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Since  - —  = 

'  2ViP 

t[f(^)-f(0)] 
Tin(t  - 


5  *  ^  > '»’ 

sin  7r(2Wt-n)  =  (-1)*^  n/2W 


+  [f(^)'f(0)]  <|>„(t;W) 


in  (3.2.6)  we  obtain 


0  =  /|f(t)-£(0)-f(0)(J)otiW)  -  y  [(-!)» 


(3.2.7)  +  f(^)(^^(t;W)  -  f(0)4.^(t;W)]|^dn^(t) 


Now  (3.2.2)  applied  to  g  gives 

(3.2.8) 


r  n 

f’(«  *  jo'”'’  "STTO - 


Also  from  the  classical  sampling  theorem  (see  Zakai,  1965)  we  have 

I  4>n(t;W)  =  1  ,  UTR^  . 


n=-o 


-N  ^ 

For  any  positive  integer  N,  let  ^^^(t)  4  'I  <J)_(t;W).  Then  for 

n=-N  " 

any  t  2  0 

(3.2.9)  lsN^(t)|  <  lS°yj(t)|  +  |sf2W^l(t)|  +  lS^2Wt]+lf^^l  * 

Consider  S^jg(t)  and  let  t  be  such  that  sin  2nWt  ^  0.  The  successive 
terms  of  S^j^(t)  can  be  written  as 


sin  2TTWt  sin  2iTWt  sin  ZirVIt  ,  ,.>N  sin  2iTWt 

2TrWt  '  ■  TT(2Wt+l)  ’  TT(2Wt+2)  Tr(2Wt+N)  ’ 


and  are  thus  alternating  in  sign  and  decreasing  in  magnitude.  It 


/ 
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follows  that  |S^jj(t)|  <,  ^  1  for  all  t  ^  0,  and  similarly 

for  and  S^2Wt]+l'  N  >  0  and  t  a  0,  |S^j^Ct)l  <  3. 

The  same  result  holds  for  t  <  0.  Thus  |S^j^(t)-l|  i  4,  and  since 
N  1 

S_j^(t)  -»■  1  for  all  teIR  ,  and  fs  a  finite  measure,  it  follows  by 
the  bouided  convergence  theorem  that  ■*•  1  in  L^Cu^)*  It  then 

follows  from  (3.2.7)  that 

0  =  /lf(t)  -  I  f(^)<|)„(t;W)|2duj(t)  , 

n=-oo 

2 

proving  the  convergence  of  (3.2.2)  in  L  (Uj^) .  Since  T  is  a  bounded 

linear  operator  on  Bj^(W),  and  hence  continuous,  (3.2.5)  follows  with 

2 

the  series  converging  in  L  (y^^) .  Masry  and  Cambanis  (1976)  showed 
that  if  h2,h2eBj^(W)  ,  then 

|h,(t)-h2(t)l  <  C(l+t^)'^|lh^-h2ll  2  .  telR^  , 

L  (up 

which  implies  that  (2.5.2)  converges  uniformly  on  conpact  sets.  □ 

Remark  3.2.2.  As  in  Ranark  3.2.1,  we  notice  that  if  the  Fourier 

A  “1 

transform  g  of  g(t)  =  [f(t)-f(0)]t  satisfies  the  condition: 

g(u)(l  +  e  ^)  ^eL^[-WQ,WQ] ,  then  (3.2.8)  and  thus  Theoran  3.2.5 
remain  true  for  W  =  Wq. 

For  k  2:  2,  (3.2.5)  is  not  valid,  since  it  is  not  valid  when  T  is 
the  identity  operator  (a  counter  example  is  f(t)  =  t  \diich  was  mentioned 
earlier).  The  following  expansion  for  k  2  2  involves  the  derivatives 
of  f  at  zero  and  the  functions  t^cBj^j(W),  0  s  j  s  k-2,  and 

^k-1  sin^2^Wt  ^  Bj^_^(W),  so  that  functions  feBj^(Wg)  are  reconstructed 
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from  their  sanqiles  and  the  values  of  their  derivatives  at  zero  using 
functions  in  Bj(W),  Is  j  <  k-1,  W  >  Wq,  i.e.  in 

Theorem  3.2.6.  Let  feBj^CWp),  k  2  2,  and  W  >  Wg.  If  T  is  a 
bounded  linear  operator  on  »  then 

(3.2.10)  [Tf](t)  =  [Tf^.i](t)  +  I  ' 


where 


fk-2") 


.  Y  f,  ,ct)  -  tX-i 

j=0  j!  ^  ^  ^  (k-l)!  ^ 


sin  2TTlVt 


A  /-Ai  ^2Wtik-l  sin  Tt(2Wt-n) 
♦n,k(«  '  i,(2Wt-n)  ' 


and  the  series  converges  in  L'^(yj^),  as  well  as  uniformly  on  c<Mipact 


sets. 


Proof.  From  (b)  of  Lemma  3.2.1  we  have 


(3.2.11)  f(t)  A  4^|f(t)  -  Y  =  kf*^^'^)(0)  +  tg(t)  , 

t^  ^  (  j*0  J-  J 

for  some  g€Bg(Wg).  Since  F(0)  =  kf^^'^^(O),  then  by  part  (a)  of  Lanma 
3.2.1  we  have  that  FcBj^(Wg)  and  then  by  (3.2.5) 


(3.2.12) 


F(t)  =  [  F(^)<J>j^(t;W)  ,  telR^  , 


where  the  series  converges  in  and  uniformly  on  compact  sets. 

Then  from  (3.2.11)  and  (3.2.12),  it  follows  that  for  all  telR^, 


(3.2.13)  f(t)  =  f^.j(t)  +  y  » 

nfO 


and  the  series  converges  in  and  uniformly  on  compact  sets. 
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We  notice  that  t^  ^eB^CW),  1  s  j  s  k,  since  t^"^eL^(Uj^)  and  for  any 
function  \l>eS  vAose  Fourier  transform  J  is  a  test  function  with 
Kt)  =  1  on  [-W,W],  and  i(!(t)  <  1  for  all  tel-W,W]  we  have 

/(t-u)^\|j(u)du  =  /t^iKu)du  +  f[  I  (i)t^(-u)^'’^]t|/Cu)<ki 

r=l  ^ 

=  t^$(0)  +  f  (ht^(-l)^'^fu^'^il>Cu)du 
r=l 

r=l  ^ 

=  tj  . 

We  also  notice  that  t^'^({ij^(t;W)  belongs  to  Bj^CW)  by  (b)  of  Lemma  3.2.1 
since  ({ij^(t;W)  Bq(W)  for  all  n.  Now  since  T  is  a  bounded  linear  oper¬ 
ator  on  Bj^(W) ,  and  hence  continuous,  (3.2.10)  holds  where  the  converg- 
2 

ence  is  in  L  (y^^) ,  and  the  uniform  convergence  on  compact  sets  follows 
by  (c)  of  Lemma  2  of  Masry  and  Cambanis  (1976) . 

Example  3.2.1.  The  m-th  derivative  operator  [D^'^'^f] (t)  =  f^^'^Ct), 
f^Bj^tWo),  m,k  2  1,  is  a  bounded  linear  operator  on  Bj^(Wq). 

Proof.  Since  feBj^CWg),  then  by  (a)  of  Lemna  3.2.1  we  have 

00 

f(t)  *  /  f(u)iKt-u)du 
*00 

A 

for  any  ipeS  such  that  is  a  syimtetric  test  function  si5>ported  by 
[-W-6,W+6]  for  some  0  <  6<Wq,  4i(t)  *  1  on  [-Wq,Wq],  and  Kt)  <  1 
on  [-Wq.Wq]^.  Hence,  for  all  tsIR^, 

[D^"'^f](t)  =  /  f  (u)  (t-u)du 


and 


QO  W 

I  (t)  I  ^  <.  /  /  1  f(u)  I  •  I  f(v)  I  •  I  (t-u)  I  •  I  (t-v)  du  dv 


Since  m^l,  then  |  (x)  |  £  ,  for  every  n  ^  0, 

and  thus  for  n  =  k. 


,2.^2  rr  i£(u)i*ifcv) 


i[D^'"^f](t)r  s  c"  /  / 


(3.2.14) 


m  k  •»  •'  2k  2l 


<  /“  /“  .  ■  ■ 
2  -oo  -CO  (l+(t-u)^)^(l+(t-v)^)’ 


-  k  /  *  2  k  » 

(l+(t-u)'^)*^ 


du  dv 


du  dv 


where  C*  ,  =  ,  j  - ,  ra,k  >  1.  From  (3.2.14)  we  obtain 

"•jX  '“jK.oo  (i+x^)*^ 


(3.2.15)  ^C;j^  /  /  - If 

L^(yJ  -«  -»  (i+t^ 


“  r“*  |£(u)|2 


(l+t^)^(l+(t-u) 


du  dt 


Now  we  argue  as  in  Lee  (1973) .  Letting 


~  ^  TTt - TY  ’ 

-»  (t+0^(l+(t-u)^)‘^ 

and  using  (1+u^)  <  2(l+t^) (l+(t-u) ^) ,  we  obtain 


and  thus 


Ik(u)  ^ 


(1+U^)' 


Ii(u) 


(3.2.16) 
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since  Ii(u)  < - 5 

^  1+u 

it  follows  that 


(Zakai,  1965). 


From  (3.2.15)  and  (3.2.16), 


L  (M^) 


I  2 

L^yj,) 


□ 


From  Example  3.2.1  we  notice  that  if  feBj^(Wg) ,  then  for  any 
W  >  Wg,  m  >  1 

fW(t)  -  fW(t)  *  .  t.IRl  , 

where  ^k-2’  *^n  k  defined  in  Theorem  3.2.6. 


We  now  obtain  a  convolution  representation  (which  is  a  variation 
of  part  (a)  of  Lemma  3.2.1)  and  an  alternative  proof  of  the  sampling 
expansion  (3.2.3)  for  functions  in  Bj^(Wg) ,  k  s  1.  This  result  is 
the  analogue  of  (3.1.1)  for  fimctions  in  Bj^(Wg) ,  k  s  1. 


Theorem  5.2.7.  Let  feBj^(Wg) ,  W  >  Wg,  and  0  <  6  <  W-Wg.  If  ijj 
is  an  arbitrary  (but  fixed)  test  function  with  support  (i|')'=[-l,l] 

00 

and  /  <|j(t)dt  =  1,  then 

>00 


00 

f(t)  =  /  f(u) 
-00 


sin  2irW(t-u) 
2TrW(t-u) 


iil(B(t-u))du 


,  telR^  , 


and  the  series  converges  pointwise  everywhere. 


Proof.  Fix  fcBj^(Wg),  W  >  Wg,  and  0  <  3  <  (W-Wg) .  Then  for  all 
scIR^,  f(*)'J(3(s-*))  belongs  to  L^(IR^).  Indeed,  for  all  zeC, 
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kez)  =  /  du  , 

-1 


and  integrating  by  parts  n  times,  we  obtain 


(-2,.i6z)"i(ez)  -  /  du  . 

-1 


Thus  for  any  n  >  1  we  have 


n-  1  2TrB|Imz|  1  ,  . 

[  zl  4^(32)  ^  - ;7  e  /  |i(;  ^  (u)  |du  , 


.n 


and  hence 
(3.2.18) 


(2716)“  -1 

27761  finz  I 


/V  C  ^e 

|^(6z)|  < 


It  follows  that  for  every  scIR^, 


/  |f(t)J(6(s-t))|^dt  ^  d  .  f  —I  I  dt 

(l+ls-tl)'^*^ 


2^^  (l+lsl)^’^  /“illl^dt  <  <» 
-00  (in^)*^ 


(since  (1+t^)^  <  2^(1+ | s | ) ^^(1+ | t-s | ) ^^  for  all  t,seIR^).  Also,  by 
by  (d)  of  Lemma  3.2.1  we  have 


|f(z)|  <  C^(l+lzl)^e  °  ,  ZcC 


and  by  (3.2.18) 


|f(z)4i(6(s-z))|  <  0^.1  z I 

‘"'^(l+ls-zl)*' 


,  27t(W-+6)|I„z| 
.  C,C,^3(l.|s|)’^e  « 


for  all  selR^  and  zcC  (since  (l+|z|)*'  s  (l+|s|)^(l+|s-zl)^) .  Thus 
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by  the  Paley-Wiener  Theorem,  we  have  that  for  all  selR^,  f(*)$(3(s-*)) 
belongs  to  Bg(WQ+3).  Since  Wg+3  <  Wg+W-Wg  =  W,  by  (3.1.1)  we  have 
that,  for  all  t,seIR^, 

oo 

f(t)k3(s-t))  =  /  f(u)  i(3(s-u))du 


(3.2.19) 


OO 


sin  iT(2Wt-n) 
■i(7Wt-h) 


4(3(s-  ^)) 


and  the  series  converges  uniformly  on  -“  <  t  <  «>.  Now  putting 
s  =  t  in  (3.2.19),  the  required  representation  (3.2.17)  follows.  □ 


3.3.  Bandlimited  in  Lloyd's  Sense. 

Our  goal  in  this  section  is  to  obtain  sampling  expansions  for 
bounded  linear  operators  acting  on  classes  of  functions  and  stochastic 
processes  bandlimited  in  Lloyd's  sense.  Lloyd  (1959)  extended  the 
concept  of  "bandlimitedness"  by  allowing  a  "bandlimited"  function  to 
have  a  wandering,  rather  than  compact,  spectrum.  An  open  set  VcIR^ 
is  called  a  wandering  set  if  there  exists  a  real  number  W  >  0  such 
that  all  its  translates  {V+2nW},  nelN,  are  disjoint.  Lloyd  derived 
a  sampling  expansion  for  wide-sense  stationary  processes  vihose 
spectral  distributions  F  have  wandering  supports,  and  also  proved 
that  if  2Wg  is  the  Lebesgue  measure  of  supp(F),  then  Wg  s  W. 

Theorem  3.3.1.  (Lloyd,  1959).  Let  {x(t),  telR^}  be  a  measurable, 
second  order,  mean-square  continuous,  wide-sense  stationary  stochastic 
process,  and  V  be  the  sipport  of  its  spectral  distribution  F.  If,  for 
some  fixed  number  W  >  0,  the  translates  {V+2nW}  of  V  are  all  disjoint 
then 
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N  I  , 

(3.3.1)  x(t)  =  lim  I  (1  -  lSi)x(^)K(t  -  ,  telR^  , 


n=-N 


where  K(t)  -  ^  !  ,  telR^,  and  if,  furthermore  lim  sup|  tK(t)  |  <  “ , 


temi 


(3.3.2) 


x(t)  =  lijn  I  x(^)K(t  -  ^)  ,  telR^  , 


n=-N 


where  the  convergence  in  both  (3.3.1)  and  (3.3.2)  is  in  the  mean  square 


sense . 


Lee  (1978)  extended  Lloyd's  result  to  functions  in  L^(yj^) 
with  wandering  (distributional)  spectra,  and  to  non-stationary  processes 
whose  correlation  functions  have  (distributional)  spectra.  Before 
stating  Lee's  results  we  introduce  the  following  notation.  Let 
X  =  {x(t) ,  telR^}  be  a  measurable  stochastic  process  with  correlation 
function  R(t,s)  =  E[x(t)x(s)],  t,S€]R^,  which  satisfies 


(3.3.3) 


/  R(t,t)dy.  (t)  <  »  ,  k  >  0  , 


1  2 

where  dy,  (t)  =  - 5-t-  dt.  We  may  define  an  operator  R  on  L  (y, )  by 

K  (i+t^)*^  ^ 

00 

[Rf](t)  =  /  R(t,s) f (s)dyj^(s) .  R  is  a  trace  class  operator,  with  non- 

-oo 

00  oo 

zero  eigenvalues  corresponding  eigenvectors  . 

Cambanis  and  Masry  (1971)  obtained  the  following  representations  for 
X  and  R: 


(3.3.4) 


00 

x(t)  =  I  fi,(t)C^  ,  tcIR^  , 


where  the  series  converges  in  ihe  mean  square  sense  and  also  in  L^(iJj^) 

2 

a,s.,  and  forms  an  orthogonal  basis  with  E|Cj^|  =  Xj^  for  the 
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Hilbert  space  H(x)  generated  (in  the  mean- square  sense)  by  the  random 
variables  of  the  process  x,  and 

oo 

(3.3.5)  R(t,s)  =  I  ,  t,S€lR^  , 

lC“  1 

2 

where  the  series  converges  absolutely  and  in  L  (pj^) . 

Remark  5.5.1.  Since  R  satisfies  (3.3.3),  then 

oo  oo  I  N  I  2 

/  /  dt  ds  <  «>,  and  hence  the  Fourier  transform  R  of  R 

-oo  -oo  (l+t  +s  j 

2  -2k  2 

exists  as  a  tempered  distribution  in  the  Sobolev  space  H  ’  (IR  ) 

(see  Trbves,  1967).  If  the  support  of  R  is  contained  in  an  open  set 
V  whose  translates  by  (2nW, 2nW),  for  some  W  >  0,  are  all  disjoint, 
then  (Lee,  1978)  for  all  k,  supp(fj^)  =  (y:  (y,y)esupp(R) }cVg  = 

(v:  (v,v)eV},  and  the  translates  of  Vg  by  2nW  are  all  disjoint. 

Let  Ug  be  an  open  set  such  that  supp(fj^)cUgcUgcVg,  let  be  a  C”- 
function  that  equals  1  on  Dg  and  0  on  V^,  and  |i(/(t)l  s  1  for  all  tcIR^, 
and  let  the  function  K  be  defined  by 

00 

(3.3.6)  K(t)  =  /  e^’'^%(u)du  . 

-OO 

2 

Theorem  3.5.2.  (Lee,  1978).  Let  feL  (Pj^)  >  and  suppose  that  there 
exists  an  open  set  V3supp(?)  such  that  for  some  fixed  W  >  0  the  trans¬ 
lates  {V+2nW},  ncIN,  of  V  are  all  disjoint.  Let  U  be  an  open  set  such 

that  supp(?)cUcUcV,  1^)  be  a  c”°-function  that  is  1  on  U  and  0  on  V^, 

00 

and  K  be  the  function  K(t)  -  ^  !  ij;(u)du  .  Then 

-OO 

(3.3.7)  f(t)  =  I  f(^)K(t  -  ^)  ,  tclR^  , 

n=-oo 


where  the  series  converges  pointwise  everywhere. 
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Theorem  3.5.3.  (Lee,  1978).  Let  {x(t) ,  telR^}  be  a  measurable, 
second  order,  mean-square  continuous  process  with  correlation  function 
R  which  satisfies  (3.3.3)  for  some  non^-negative  integer  k.  Let  V  be 
an  open  set  such  that  supp(R)cV,  and  suppose  that,  for  some  W  >  0, 
the  translates  {V  +  (2nW,2nW)},  nelN,  are  all  disjoint.  Then  for  each 
celR^, 

oo 

(3.3.8)  x(t)  =  I  x(^)K(t  -  2^)  , 

n=-oo 

where  the  series  converges  in  quadratic  mean  and  almost  surely,  and 
K  is  defined  as  in  Remark  3.3.1. 

We  now  generalize  Kramer's  expansion  (3.2.1)  to  bandlimited  fionc- 
tions  with  wandering  spectra  and  Lee's  expansion  (3.3.7)  (the  case 
k  =  0)  to  bounded  linear  operators  acting  on  the  space  L^(U,V;W) 
which  is  defined  as  follows.  Let  U  be  an  open  set  in  IR^  such  that 
for  some  open  set  V  ^  U  and  W  >  0  all  the  translates  {V  +  2nW},  neIN 
are  disjoint.  The  class  of  all  functions  feL  (pj^)  with  supp(f)cU 
is  denoted  by  Lj^(U,V;W) ,  and  simply  by  fj^(U)  when  the  set  V  is  not 
required  to  have  the  properties  stated  above.  Since  the  translates  of 
U  are  disjoint,  its  Lebesgue  measure  is  finite  (Lloyd,  1959),  for 
k  =  0,  feL^(]Rb  n  L^(]R^).  It  follows  that 

(3.3.9)  f(t)  =  /  f(u)du  ,  a.e.  , 

-OO 

and  thus  every  function  in  Lg(U;V,W)  has  a  continuous  version.  Only 
continuous  versions  will  be  considered  in  this  section. 

Theorem  3.3.4.  If  T  is  a  bounded  linear  operator  in  L^(II^)  such  that  T 
maps  Lg(Ug,Vg;W)  into  Lq(Uq,Vq;W) ,  and  K  is  defined  as  in  Theorem  3.3.2, 
then  for  every  trlR^, 
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(3.3.10)  [Tf](t)  =  I  f(^)[TK(-  -^)](t)  , 


n=- 


W 


1  2  1 
and  the  series  converges  uniformly  on  IR  as  well  as  in  L  (IR  ) 


Proof.  Define  the  function  F  by 

“  1 
F(u)  =  I  ?(u-2mlV)  ,  uelR-*-  . 


in=-a> 


F  is 


is  the  2W-periodic  extension  of  f,  and  /  |F(u)|^du  ®  ||f||  ^  , 

L^(]R^) 

2 

where  =  (-W,W).  Thus  from  the  L  -theory  of  Fourier  series,  F  has 
the  Fourier  expansion 


N  -iri  S  u 


(3.3.11) 


F(u)  =  lim  I  C  e  , 

_ 


n='N 


in  L^(-W,W),  where 


.  n 

1  ,  Tfi  jV  u 

^n  ■  2W  / 


=  -i  f 

2W  J 


vw 


.  n 

TTl  jT  U 

F(u)e  "  du  (U^=U+2mW) 


iri  S  u 


=  B  I  ^  f(u-2inW)e  ^  du 


m  Ij^nU^ 


TTi  S  U 


J  ^  ..^(u)e  du  . 


m  Iy^U^-2mW 


But  the  sets  '  2mW  =  (I^^  -  2mW)  n  U  are  disjoint  and  their 

union  is  iJ,  so  that 

1  ,  -  S  ^  1  n 

^n  ^  2W  i  W  • 

U 


(3.2.12) 
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We  notice  that  for  any  geLQ(U,V;W), 

(3.3.13)  |g(t)|  <  /|g(u)e2^i^''|du  <  |U|’'*||g||  ^  ,  . 

tJ  L  (IR  ) 

where  |U|  is  the  Lebesgue  measure  of  U;  i.e.,  the  evaluation  map 

on  Lq(U;V,W)  is  bounded  with  norm  s  lUI*^. 

Now  consider  the  error 


N 


-  llTfl(t)  -  I  fCjXTKC-  4)Kt) 


n=-N 


N 


<  |U|"||Tf  -  I  f(^)[TK(--  ^)] 


n=-N 


2W 


I  2  1 


N 


^  |U|"||T|H  /  |f(t)  -  I  f(^)K(t  -  4)|^dt} 


n=-N 


ZW 


-TTi  S  u 


5  lUl’IlTlII/  |t(u)  -  J  ^f(^)e  «  |2 


n=-N 


du 


(3.3.14) 


N 


/^k(u)|  I  I  2W 


V-U 


n=-N 
N 


.  n 

-TTl  rj  U  ,  , 

le  l^du}’'* 


^  lUl’IlTlU/lFCu)  -  I  C„e  "  Vdu 

n=-N 


U 


N 


.  n 

-TTl  j-7  U  -  , 

•■  /_  I  I  c  e  l^du}^  . 

V-U  n=-N  " 


By  (3.3.11)  and  noting  that  I-(u)  =  0  on  V-U,  it  follows  that  the 
right  hand  side  of  the  last  inequality  in  (3.3.14)  tends  to  zero 
independently  of  t,  then  ejj(t)  converges  to  zero  uniformly  in  t  on 

m^.  □ 

We  now  consider  the  stochastic  analogue  of  Theorem  3.3.4  for 
processes  bandlimited  in  Lloyd's  sense  which  are  not  necessarily 
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stationary.  To  fix  notation,  let  x  *  {x(t),  telR^}  be  a  measurable, 
second  order,  mean-square  continuoxis  process  with  correlation  func¬ 
tion  R  which  satisfies  (3.3.3)  for  k  =  0.  Assume  that  V  is  an  open 
2 

set  in  IR  such  that,  for  some  fixed  W  >  0,  the  translates  {V+(2nW,2nW)}, 

2 

ncH ,  of  V  are  all  disjoint,  and  let  U  c  V  be  a  fixed  open  set  in  IR  . 

If  supp(R)  c  u,  then  almost  all  sample  paths  of  x  belong  to 

^0  “  and  Vq  =  {v:  (v,v)cV}  (Lee,  1978). 

It  then  follows  from  Theorem  3.5.4  that  if  T  is  a  bomded  linear  oper¬ 
ator  in  L^(IR^)  such  that  T  maps  Lq(Uq,Vq;W)  into  lQ(UQ,Vg;W),  then  with 
probability  one 

(3.3.15)  [Tx](t)  =  ,  telR^  , 

1  2  1 

where  the  series  converges  uniformly  on  IR  ,  as  well  as  in  L  (IR  ) . 

We  show  that  under  appropriate  conditions  on  the  operator  T 
(Theorem  3.3.5)  or  on  the  correlation  function  R  of  the  process  x 
(Theorem  3.3.6)  the  expansion  (3.3.15)  converges  also  in  quadratic 
mean. 

2  1 

Let  T  be  a  bounded  linear  operator  in  L  (IR  )  of  integral  type 
with  kernel  SeL^(IR^): 

00 

(3.3.16)  [Tf](t)  =  /  S(t,u)r(u)du  a.e.,  f£L^(lR^)  , 

-oo 

and  assione  that  the  kernel  S  satisfies  the  following  conditions; 

(i)  S(t,*)£L^(IR^)  for  all  t£lR^  and  t  t->S(t,*)  is  a  contin- 

1  2  1 

uous  map  from  IR  into  L  (IR  ) ,  so  that  each  Tf  has  a 
continuous  version  for  which  (3.3.16)  holds  for  all  t£lR^. 

(ii)  S£[Lo(Ug;Vo,W)  a  LQ(Ug;Vg,W)]  a  (L^R^  •  so 

that  T  maps  LQ(Ug;V,W)  into  LQ(Ug;V,W),  (note  that 

'•o'uS)  ■ 
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(iii)  /  (1+u^) |S(t,u) |du  <  «  for  all  tcIR^. 

o'OO 

Since  the  sample  paths  of  x  belong  to  LQ(Ug;VQ,W)  a.s.,  we  have  with 
probability  one 

00 

(3.3.17)  [Tx(*,a))](t)  =  /  S(t,u)x(u,aj)du  ,  for  all  tclR^, 

-GO 

and  we  now  show  that  under  condition  (iii)  on  the  kernel  S  of  T,  the 
series  in  (3.3.15)  converges  also  in  quadratic  mean  for  each  telR^. 

Theorem  3.3.5.  Let  x  =  {x(t.) ,  tclR^}  and  T  be  as  defined  above. 

Then 

00 

(3.3.18)  ['I^}(t)  =  I  x(^)[TK(*  -■^)](t) 

n=  -00 

where  the  series  converges  in  the  mean  square  sense  for  every  telR^, 
and  K  is  as  defined  in  Remark  3.3.1. 


Proof.  Recall  the  expansion  (3.3.4)  of  x  where  the  series  con- 
2  1 

verges  in  L  (IR  )  a.s.  Since  almost  all  sainjle  paths  of  x  as  well  as 
all  fj^  belong  to  Lq(Uq;V,W),  (Lee,  1978),  and  since  T  is  a  continuous 
linear  operator  on  Lg(UQ;VQ,W),  it  follows  that  with  probability  one. 


(3.3.19)  [Tx](t)  =  I  [Tfj^lCt)C. 

k=l 

2  1 

in  L  (IR  )  and  also  pointwise  everywhere  by  (3.3.13).  Thus,  for 
every  tcK^,  we  have 


N  ^ 

E|[Tx](t)  -  nTfJ(t)C,,|^  =  E|  I  [TfJ(t)C.|^ 
k=l  ^  k=N+l 

00  oo 

=  I  I  |[Tf,^](t)|*|[Tf  ](t)|n(c^L) 

k-N+l  p=N+l  P  ^  P 

=  I  Ai,l[TfJ(t)l2  . 
k-N+1 


i 
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But  by  (3.3.13) 


[Tfj^Kt)!^  <  |uH1t£j^1|22  1  ^  |uH|t||^||%||^2  i 

^  L^(1R  )  r(]R^) 

=  luHlTll^  . 


Thus  for  every 

El[Tx](t)  -  <  lUHUll^  I  X,  ^OasN^», 

k=l  k=N+l 

and  the  series  in  (3.3.19)  converges  in  the  mean  square  sense,  for 
each  telR^. 

Now  consider  the  mean  square  error 

e^(t):  =  E|[Tx](t)  -  ^  x(^)  [TK(*  -  ^)](t)|^  ,  tclR^  . 

n=-N 

Making  use  of  the  convergence  of  the  series  in  (3.3.19)  in  quadratic 
mean  for  each  telR^,  we  obtain 

e;5(t)  =  |[Tx](t)r  -  I  E([Tx](t)x(^))[TK(.  -3g)](t) 


n=-N 


2W'' 


N 


I  E([T^](t)x(^))[TK(-  -  ^)](t) 


2W 


n=-N 
N  N 

*  I  I  E(x(^)x(-^))[TK(-  -  ^)l(t)[TK(-  -  4)](t) 


n='N  m*-N 


=  I  X  {|[Tf^^](t)|2  -  I  -  ^)](t) 

k*l  n=-N 


N 


n«-N 

*  I  I  -  ^)l(t)} 

n*-N  HF-N 


(J.3.20) 
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We  have 


N 


■  „L^  fk'wHncc-  -  ^)l(t)| 


n 


<  /  |SCt,u)l.|fj,Cu)  -  I  f^lS^KCu  -  ^)|du 

-00  n=-N 


=  /  lS(t,u)|-|J  tiv) 


ZiTiuVj 
e  dv 


N 


TTi  S  V 


I  [  j  f^(v)e  dv)K(u  -  ^)ldu 


^  k 

n=-N  Uq 


s  /  lS(t,u)l*(  /  |£j^(v)|*|e 


Ziriuv 


U, 


0 


N  ffi  S  V 
I  e  K(u  -  ^)|dv)du  . 
n=-N 


(3.3.21) 


For  every  uelR^,  define  <J)y(v)  =  (Lee, 


1978).  Then  for  each  ueK^,  is  a  periodic  C  -function  with  Fourier 


expansion 


"  „  TTi  S  V 

n=-oo 


where  the  series  converges  uniformly  on  -<»  <  v  <  “.  We  have 

N 

Yf,,  .  _ , 

2W^ 


■  H 

f  \ .  1  27riuv  r  n.  W 

ej.(u):  =  sup  le  -I  K(u  -  ^)e 

V6Uq  n=-N 


N 


s  sup  I  (j)  (V)  -  I  K(u  -  ^)e 
velR^  “  n=-N 

nf 


n^/^  W 


=  sup 
VelR^  |nI>N 


K(u  -  4)e  I 


f  I  Xml  i 
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^  .  I  -  ^)l  . 


ln|>N 


and  since  KeS  implies  |K(u)|  < - ^  sane  C  >  0  , 


l+u‘ 


^  lnl>N  1  +  (u- 

<  2c(i+u^)  y  - ^-7 

|n|>N  1  + 


N 


From  (3.3.21)  we  thus  have, 


^  lS(t,u)  lej^(u)du  /  |fj^(v)|dv 


^0 

^  /  (l+u^)ls(t,u)|du  . 

-00 

It  follows  frcrni  (3.3.20)  that  for  all  tcR^, 

,  lU.ldOW^C)^  ~  »  , 

ejJ(t)  <  — y-_ - (  I  xj  /  (1+u^)  lS(t,u)  Idu  0  as  N  « 

N  k=l 

by  property  (iii)  of  S,  and  thus  the  series  in  (3.3.18)  converges  in 
the  mean  square  sense.  □ 


It  should  be  noted  that  the  integral  type  operator  T  was  defined 
2  1 

on  all  fcL  (IR  )  since  K  i  Lq(Uq;Vq,W).  However,  one  could  take  the 

C*- function  il)  (of  Ranark  3.3.1)  equal  to  zero  on  for  some  open  set 

A  such  that  ^  S  '^O*  KeLQ(A;VQ,W) ,  and  it  would 

suffice  to  define  the  integral  type  operator  T  on  Lq(A;Vq,W)  ,  rather 
2  1 

than  on  L  (H  )  (also  conditions  (i)  and  (ii)  would  need  the  obvious 


modifications) . 
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Under  further  conditions  on  the  process  x,  (3.3.15)  converges 
in  quadratic  mean  for  all  bounded  linear  operators. 

Theorem  3.3.6.  Let  x  =  {x(t),  teR^}  be  as  in  Theorem  3.3.5, 
and  in  addition  assume  that 


(i)  /  (l+t^)/R(t,t)  dt  <  oo 

-00 

Cii)  I  (1  • 


<  «>  . 


2  1 

Then  if  T  is  any  bounded  linear  operator  in  L  (IR  )  vdiich  maps 

’  (3.3.15)  holds  vdiere  the  series  converges 
in  quadratic  mean  for  every  teR^. 

Proof.  Notice  that  by  (3.3.20)  we  have 

e^Ct)  ^  ||T||2  I  A^llf  -  I  y^)K(-  -  ^)||  2  1 

k=l  |n|sN  L^(R^) 

It  follows  by  (3.3.5)  and  monotone  convergence  that 

00  00 

Ik=i^k  ^  I I  dt  =  /  R(t,t)dt.  By  (3.3.4)  we  obtain 


/  Mt,2g)K{t  ■  J)dt  •  n(  ;  x(t)K(t  -  ^dfx(^)l 


i  Vkta)l> 
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=  f}j(t)K(t  -  2!J)dt  , 


and  thus  (3.3.22)  can  be  written  as  follows: 


e^(t)  ^  llTir  /  |[R(t,t)  -  ^)K(t  -  ^)] 


I  1^ 

n  UN 


(3.2.23) 


•  K(t  -  ^)ldt 


But  by  Theorem  3.3.3  we  have  for  every  t,se]R^ 


R(t,s)  =  I  R(t,  ^)K(s  -  2^)  ; 


substituting  in  (3.3.23)  we  obtain 

e^(t)  ^  llTll^i  /  I  lR(t,  ^)||K(t  -  ^)|dt 
-CO  |n|>N 


^  |n|L  * 

Since  KeS  implies  |K(t)|  <  - *-i-  for  each  k  s  0  and  some  C.>  0, 

(l+t^)*'  k 

and  |R(t,s)|  s  »11(t,t)  •  /k(s,s) ,  we  have  that  the  first  term  on  the 

right  hand  side  of  (3.3.24)  is  less  than 

2CJ|T[|\/  (ln^)v^rt:tT  dt)  I  :(E((n/2W)  (y2Wj2  0  as  N  ^  0°, 

|nI>N  1  +  (^)^ 


by  (ii).  For  the  second  term,  notice  that 
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by  (ii)  and  the  result  follows.  0 

It  should  be  noted  that  when  R(t,t)  is  asymptotically  monotonic 
at  ±<»  then  conditions  (i)  and  (ii)  of  Theorem  3.3.6  may  be  replaced  by 

/  (l+t^)»^(t,t)  dt  <  <»  . 


-oo 
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CHAPTER  IV 

Sampling  Expansions  for  Distributions  and 
Random  Distribut ions 


4.1.  Introduction. 

This  chapter  is  concerned  with  sampling  representations  for 
distributions  and  random  distributions.  The  need  to  consider  dis¬ 
tributions  (beyond  classical  functions)  arises  fran  the  fact  that  in 
many  physical  situations  it  may  be  impossible  to  observe  the  instan¬ 
taneous  values  f(t)  (of  a  physical  phenomenon)  at  the  various  values 
of  t.  For  instance,  if  t  represents  time  or  a  point  in  space,  any 
measuring  instrument  would  merely  record  the  effect  that  f  produces 

on  it  over  non-vanishing  intervals  of  time  I:  /f (t)<J)(t)dt,  where  4) 

I 

is  a  "smooth"  function  representing  the  measuring  instrument,  i.e. 
the  physical  phenomenon  is  specified  as  a  functional  rather  than  a 
function.  Furthermore,  it  is  becoming  exceedingly  clear  that  the 
tools  and  techniques  of  the  theory  of  distributions  are  useful  in 
investigating  certain  problems  in  many  applied  areas.  It  is  thus  of 
interest  to  consider  distributions  beyond  functions. 

4.2.  Notation  of  Basic  Definitions. 

Let  c”  =  c”(IR^)  be  the  class  of  all  infinitely  differentiable 
functions  with  compact  support.  A  topology  t  is  introduced  on 
the  linear  space  c”  which  makes  it  into  a  complete  space:  -»•  0 

in  T  if  there  exists  a  compact  set  AcIR^  which  contains  the 
siqiport  of  every  4)^^,  and  for  every  non-negative  integer  k,  4>^^^  (t) 

-*•  0  uniformly  as  n  c”  with  the  topology  x  is  denoted 


by  V,  and  its  elements  are  called  test  functions.  The  members  of  the 
dual  V  of  P  are  called  distributions,  and  the  value  of  a  distribution 
feP'  at  a  test  function  (^eV  is  denoted  by  A  (weak-star)  topo¬ 

logy  on  V  is  defined  by  the  seminorms  |f((j))i,  feV,  as  (p  varies 
over  all  elements  of  V;  thus,  0  weakly  whenever  fj^(<t))  -*■  0  for 

all  peV. 

The  class  S  of  rapidly  decreasing  functions  consists  of  all 
infinitely  differentiable  functions  (<J)eC°°)  for  which 

|t"’<))*'^^  (t)  I  <  ,  -oo  <  t  <  -», 

for  all  non-negative  integers  m,k.  A  topology  on  S  is  defined  by  the 
seminorms 

,  m,k  =  0,1,2 . 

’  0<n<m  tcRl 

OO 

i.e. ,  a  sequence  is  of  functions  in  S  is  said  to  converge  in  S, 

if  for  every  set  of  non-negative  integers,  the  sequence 
{ (1+ 1 1 1  (t)  converges  uniformly  on  ]R^.  S  is  complete,  and 

the  dual  S'  of  S  is  called  the  class  of  tempered  distributions.  Simi¬ 
larly,  a  (weak-star)  topology  is  defined  on  S'  by  the  seminorms  lf(<}))l, 

feS',  as  p  varies  over  all  elements  of  S,  i.e.,  f^  converges  in  S' 
if  fj^(<t>)  converges  for  all  peS.  The  space  P'(S')  is  (weak-star) 
sequentially  comiilcte,  that  is,  if  {fj^}^  is  a  sequence  inP'(S’)  such 
that  is  a  Cauchy  sequence  for  every  (()eP(S),  then  there  exists 

a  distribution  ffP'(S')  such  that  f  -*■  f  in  P'(S’). 

n  ' 

.  OO 

Finally,  the  space  C  with  the  topology  defined  by  the  seminorms 

I  sup|(t)f’'^(t)|  ,  , 

0<nsm  teA 

where  A  ranges  over  all  compact  sets  in  IR^  and  m  over  all  non-negative 


/ 
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by  V,  and  its  elements  are  called  test  functions.  The  manbers  of  the 
dual  V  of  V  are  called  distributions,  and  the  value  of  a  distribution 
feP'  at  a  test  function  (PeV  is  denoted  by  f  ((}))•  A  (weak-star)  topo¬ 
logy  on  V  is  defined  by  the  seminorms  |f((}))|,  feO',  as  (})  varies 
over  all  elements  of  P;  thus,  P'sf^-*-  0  weakly  whenever  f^(4>)  -*•  0  for 
all  (^eV. 

The  class  5  of  rapidly  decreasing  functions  consists  of  all 
infinitely  differentiable  functions  ((^eC”)  for  which 

It^^^^Ct)!  <  ,  -00  <  t  <  », 

for  all  non-negative  integers  m,k.  A  topology  on  S  is  defined  by  the 
seminorms 

{(l+|t|)^|<t)*'"^(t)  |}  ,  m,k  =  0,1,2,..., 

OsnsmteRl 

00 

i.e.,  a  sequence  is  of  functions  in  S  is  said  to  converge  in  S, 

if  for  every  set  of  non-negative  integers,  the  sequence 
{ (1+ 1 1 1 )"'(})^^^  (t)  converges  uniformly  on  ]R^.  S  is  complete,  and 
the  dual  S'  of  S  is  called  the  class  of  tempered  distributions.  Simi¬ 
larly,  a  (weak-star)  topology  is  defined  on  S'  by  the  seminorms  |f((l))|, 
feS',  as  <p  varies  over  all  elements  of  S,  i.e.,  f^  converges  in  S' 
if  fj^(<t>)  converges  for  all  4)eS.  The  space  P'(S')  is  (weak-star) 
sequentially  complete,  that  is,  if  (fj^}j^  is  a  sequence  in  P'(S')  such 
that  t  is  a  Cauchy  sequence  for  every  (t)eP(S) ,  then  there  exists 

a  distribution  ffP'(S')  such  that  f^  -*■  f  in  P'(S'). 

oo 

Finally,  the  space  C  with  the  topology  defined  by  the  seminorms 

^m  "  I  sup|(t)^"^(t)  I  ,  (f>€C”  , 

Osnsm  teA 

.»>«  ff'  \  r.inges  over  all  compact  sets  in  IR^  and  m  over  all  non-negative 
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integers,  is  denoted  by  E. 

The  Fourier  transform  F(F(<t))  =  $,  <t>eS)  is  a  one-to-one  bi- 
contii’uous  mapping  from  S  onto  itself.  If  feS',  the  Fourier  trans¬ 
form  f  of  f  is  defined  by  =  f(<j)) ,  (JJeS,  and  is  a  tesipered  dis¬ 
tribution.  If  feS'  and  (peS,  the  convolution  f*(j)  is  defined  as  a 
function  on  IR^  by 

(f*4))(t)  =  f(T^$)  ,  telR^  , 

where  ^(t)  =  (l)(-t)  and  the  shift  operator  is  defined  by  (T^(j))  (u)  = 

00 

<p(u-t).  f*4)eC  has  a  polynomial  growth  and  thus  determines  a  tanpered 
distribution. 

Sippose  feP',  f  is  said  to  vanish  in  an  open  set  UciR^  if  £(<())  =  o 
for  every  peV  with  supp(4))cU.  Let  V  be  the  union  of  all  open  sets 
UeIR  in  which  f  vanishes.  The  conplement  of  V  is  the  support  of  f. 
Distributions  with  compact  supports  are  tempered  distributions.  Now, 
if  f  is  a  distribution  with  compact  sv^yport  (i.e.,  feS'),  then  f 
extends  uniquely  to  a  continuous  linear  functional  on  E.  If  ijycP  is 
such  that  i;y(u)  =  1  on  some  open  set  containing  supp(f) ,  then  \|)f  =  £ 
i.e.  (i|yf) (ij))  =  fCM)  -  f(<P)  for  all  (peS,  but  since  e^(u)  = 
is  a  C  -function,  f(e^)  =  exists,  and  the  distribution  ?  is 

generated  by  the  function  f(t)  defined  on  by 

(4.2.1)  ?(t)  =  f(ep  . 

Indeed 

(4.2.2)  f  =  (,j,f)"  , 

and  (ijyf)  (and  therefore  f)  is  generated  by  the  C”- function  (?*ij;)  (t) 


/ 
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which  has  a  polynomial  growth  (see  Rudin,  1973,  p.  179).  By  choosing 
(j)cS  such  that  (|)  =  ij;,  we  have 

(f*$)(t)  =  (J*|)(t)  =  f(T^(())  = 

=  f(e^$)  =  f(ii;e^)  =  fCe^  , 

and  from  (4.2.2),  (4.2.1)  is  justified.  Hence  the  Fourier  transform 
of  a  distribution  with  compact  support  may  be  thought  of  as  a  function 
defined  on  IR^  by  (4.2.1), 

Let  (fi,F,P)  be  a  probability  space.  A  random  distribution  is  a 

continuous  linear  operator  from  V  (or  S)  into  a  topological  vector 

space  of  random  variables.  Specifically,  a  second  order  random 

distribution  is  a  continuous  linear  operator  from  V  (or  S)  onto 
2  2 

L  (f2)  =  L  (fi,F,P),  the  Hilbert  space  of  all  finite  second  moment 
random  variables. 


4.3.  Sampling  Expansions  for  Certain  Distributions. 

In  this  section  we  establish  a  sampling  theorem  for  totpered 
distributions  whose  Fourier  transforms  have  compact  supports.  A 
distribution  fcS’  is  said  to  be  W-bandlimited,  W  >  0,  if  supp(f)  c 
(-W,W).  The  class  of  all  W-bandlimited  distributions  will  be  denoted 
by  B^(W). 

Let  P[-W,W],  W  >  0,  be  the  class  of  all  c“-functions  (p  with 
supp((|))  c  [-W,W],  and  define  Z(W)  4  P[-W,W]  =  {$eS:  (})6l?[-W,W] } . 
Pfaffelhuber  (1971)  stated  that  if  HcB^(W)  and  h  is  its  Fourier  trans¬ 
form  (defined  as  a  function  on  K^),  then 


h(t)  =  I 


n=-o 


h(^) 


sin  TT(2Wt-n) 

~n(2W^'nr 


(4.3.1) 


and  the  series  converges  absolutely  in  Z’(W)  (the  dual  of  ZCW)). 
(4.3.1)  means  precisely  that,  for  every  (t»€Z(V0 , 


/"hCtJKtjdt  -  , 

and  the  series  converges  absolutely.  Canpbell  (1968)  had  already 
noted  that  (4.3.1)  does  not  hold  pointwise  for  arbitrary  bandlimited 
distributions.  Though  (4.3.1)  is  correct,  the  arguments  presented  in 
its  proof  are  not  convincing. 

The  following  lemma  is  a  modification  of  Lenina  1  of  Pfaffelhuber 
(1971),  and  will  be  needed  in  the  proof  of  theorem  4.3.1. 

A 

Lemma  4.3.1.  Let  feS'  be  such  that  f  has  compact  support.  Let 

A 

r,  be  a  closed  set  properly  containing  supp(f) ,  and  any  test  function 
with  support  E  and  =  1  on  some  open  set  containing  sijpp(?) .  Then 
f  is  uniquely  determined  by  its  restriction  to  P(E) ,  i.e.,  the  values 
f(0),  eeP(f),  by 


(4.3.2)  f(<l>)  =  f('l'*<l*)  >  4’cS  . 

The  shift  operator  is  defined  on  I7'(S'),  for  every 
by 

(Tj^f)(4»)  =  ,  (j)eP(5)  . 

A  distribution  feP'(S')  is  said  to  be  periodic  with  period  T  >  0,  if 


(4.3.3)  (Tjf)((|>)  =  f(<{))  ,  for  every  (()€P(S)  , 

and  T  is  the  smallest  positive  number  for  \diich  (4.3.3)  holds. 
We  now  state  and  prove  our  result. 


j 


1 
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Theorem  4.3.1.  Let  feS'  be  a  tenqjered  distribution  such  that 
f  has  compact  support,  and  let  the  closed  set  E  and  W  >  0  be  such 

that  E  3  supp(f)  and  the  translates  {E+2nW},  n  0,  are  disjoint 

/\ 

from  suppCf).  Let  a  and  [jj  be  any  test  functions  such  that  ip  has 
support  E,  and  a  =  1,  ip  =  1  each  on  some  open  set  containing 
supp(J).  Then 


(4.3.4) 


where  K^(t) 
If  feB^(W) , 


fC^-)  =  I  f(T  ^)(t  ,  (peS  , 

2W  2W 

^  /  e^''^%(u)du  and  K^^((^))  =  /  K^^(t)4>Ct)dt,  <PeS. 


then 


(4.3.5)  f((t.)  =  I  f(T  ^S)(t  j^G|^)  (W)  ,  (peS  , 


n=- 


2W  2W 


where  Gj^(t)  =  ,  and  Gj^((t))  =  /  Gj^(t)4.(t)dt  ,  <DeS. 


Proof.  We  first  show  that  the  sequence  of  partial  sums 
N 

^  "  ^n=-N^-2nW^  ,  N  >  1,  converges  in  S'.  For  any  (peS, 


^C<P)  =  I 


=  I 

n*-N 


(4.3.6) 


- 

n=“N 
..  N 
n— N 


where  ^eP  is  a  test  function  such  that  C(t)  •=  1  on  sane  open  set 
containing  supp(?).  We  now  show  that  the  sequence 
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(J)(t-2nW),  Nil,  converges  in  S.  Since  ^eS, 

2  -1 

there  exists  a  constant  B  >  0  such  that  |<|)(t)|  <  B(l+t  )  for  all 
te]R^,  and  thus 

2 

|(j)(t-2nW)|  s  - 5 -  ^  2B  -  A  . 

l+(t'2nW)^  l+(2nW3^ 

Since  CeP,  we  have  supp(C)  c  ['C,C]  for  some  C  >  0  and  lC(t)|  <  A 
for  some  A  >  0.  It  then  follows  that  for  all  telR^  and  non-negative 
integers  m, 


(4.3.7)  (l+|t|)"*U(t)l  I  l<{.(t-2nW) 

n=-N 


<  2AB(1+C)"’(1+C^)  I 


n=-«>  l+(2nW) 


2 


i.e.,  the  sequence  of  partial  sums  on  the  left  hand  side  of  (4.3.7) 
converges  uniformly  on  IR^.  Hence  the  sequence  (l+|tl)"*4j^(t) ,  N  >  1, 

converges  uniformly  on  IR^  for  every  m  i  0.  Similarly,  it  can  be 

shown  that  for  every  m,k  >  0,  the  sequence  (l+|t|)"*<I'j^^^(t),  Nil, 
converges  uniformly  on  IR^,  i.e.  Nil,  converges  in  S,  and  since  S 

is  complete,  its  limit  ^  belongs  to  S,  and  $  in  S.  It  follows 

from  (4.3.6)  that 

Sf^C4>)  =  ?(4>j^)  -►  f(4')  ,  as  N  -*■  <*> 


and  since  S'  is  (weak-star)  sequentially  complete,  then  there  exists 
a  tempered  distribution  FeS'  such  that  Sj^  F  in  S'. 

Therefore,  F  =  lim  Sj^  =  ^-2nW^  ®  periodic  ten?jered 

N-xx} 

distribution  with  period  2W.  It  follows  that  F  has  the  Schwartz- 
Fourier  series  (Zemanian,  1965,  p.  332) 
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(4.5.8)  F- J 

2V  T!W 

where  e^(u)  =  ,  and 


_n^  ♦ 

2W  ■  2W 

where  Uet]2^^  is  a  unitary  function  (Zemanian,  1965,  p.  315),  i.e. 
UcP  and  l“^.„U(t-2nW)  =  1  for  all  telR^.  From  (4.3.8)  we  have 

n) 

2W  ^ 

■  n)  • 

■  2W 

/\ 

Since  f  has  a  compact  support  and  UeP,  then  there  is  only  a  finite 
number  of  non- zero  terms  in  the  last  suiranation,  and  hence 

™  “  n'  Jl’ 

^  2W 


(4.3.9) 


f(e  ^)  =  f(ae  ^)  =  f(T  Jl) 
’  2W  ■  "ZW  ■  2W 


From  (4.3.8)  and  (4.3.9),  we  have  that 

(4.3.10)  f(e)  =  J  ^f(x  _^a)e^(0)  ,  0eO(E)  , 

■  2W  2W 

“  iri  Su 

where  e  ^(0)  =  /  e  "  0(u)du  =  0(-  Thus 

(4.3.11)  f(6)  .  f(e)  -  I  3!  £(t  i)e(J)  ,  U(E)  , 

n—  ^ 


i 
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and  by  Lemma  4.3.1  we  have  that  for  every  (peS  i. 

(4.3.12)  f((|))  *  ^  I  f(T 

"*■"  2W 

V 

(since  $*4)  =  (#)^  e  ^(E)).  But 

00 

(iil*4>)(^)  =  /  ^(^  -  t)4>(t)dt 

-oo 


=  2W  /  K^^(t  -  ^)<|>(t)dt 
•00 

(4.3.13)  =  2W(t  (4))  ,  (PeS, 

W 

and  (4.3.4)  follows  from  (4.3.12)  and  (4.3.13). 

To  prove  (4.3.5)  notice  that  when  0eP[-W,W], 


e_^(e) 

2W 


W  TTi  g  u 

=  /  e  e(u)du 
-W 


sin  ■rr(2Wt+n) 
Tr(2Wt+n) 


0(t)dt 


=  2W(t  ^y(0)  . 

■  2W 

It  follows  from  (4.3.10)  that  for  0eP[-W,W], 


f(0)  =  J(0)  =  I  f(T  j^a)(T  (9)  . 

2W  ^ 

and  (4.3.5)  follows  by  Lemma  4.3.1.  0 


Theorem  4.3.1  shows  that  a  tempered  distribution  f  with  contact 
spectrum  can  be  reconstructed  via  (4.3.4)  frran  its  values  (samples) 
at  the  translates  of  an  arbitrary  but  fixed  test  function  a  which 


equals  one  on  some  open  set  containing  supp(?) .  On  the  other  hand, 

if  we  denote  J(ep  by  f(t),  then  frm  (4.3.9)  we  have 

f(T  Ji)  =  f(e  =  f(^)  ,  and  (4.3.4)  reads 
2W  W 

f(<D)  =  I  f(^)(T  j^Kj^)(({.)  ,  <l>eS  , 

m 

so  that  a  tempered  distribution  f  with  compact  spectrum  can  be  recon- 

/V 

structed  using  the  samples  of  the  function  f(t)  =  f(e^). 

We  now  show  that  the  sampling  theorem  for  tempered  distributions 
with  compact  spectrum  includes  as  special  cases  the  sampling  theorems 
for  conventionally  bandlimited  functions  (Example  4.3.1)  as  well  as 
for  bandlimited  functions  in  L  (pj^)  (Exanqjle  4.3.2). 

Example  4.3.1.  (Conventionally  bandlimited  functions) .  Let 
feL  (IR  )  be  a  continuous  function  such  that  f  has  caipact  support 
E.  Then  f  determines  a  tempered  distribution: 

oo 

(4.3.14)  f(<|))  =  /  f(t)(j)(t)dt  ,  (peS  , 

-OO 

and  its  distributional  Fourier  transform  (denoted  also  by  f)  is 
defined  by  ?(({>)  =  f($),  peS,  or  equivalently  by 

OO 

f(<l>)  =  /  f(u)(|)(u)du  ,  4)eS  . 

-OO 

f  (as  a  tempered  distribution)  is  supported  by  E.  Hence  (4.3.4) 
applies  and,  if  W  >  0  is  defined  as  in  Theorem  4.3.1,  we  have  from 


84 


For  V  >  0,  define  the  function 


^^(t)  = 


1  -  (J) 


for  Ivl  ^  f  » 


where  C  =  /  exp{ — For  each  v  >  0,  (Ji  eP  and  /  4  (t)dt  =  1, 

V  •«  /’t'v  I*  V  - _  V 

and  for  each  continuous  function  g  and  every  telR^, 

oo 

/  g(u)<J)  (t-u)du  ■+•  g(t)  as  viO.  from  (4.3.4)  we  thus  have  that 
^  1 

for  each  teIR  and  v  >  0 

OO  00  oo 

(4.3.15)  /  f(u)<J)^(t-u)dt  =  'I  f('2j)  /  Kj^(u-2^)())^(t-u)du  . 


Since  f  and  K.^,  are  uniformly  continuous,  we  have  for  each  fixed  telR^ 


and  neIN 


/  f(u)())^(t-u)du  -►  f(t)  as  V'l'O  , 


/  K^(u  -  ^)4.^(t-u)du  -  K^^(t  -  ^)  . 


Now  by  Theorem  24  of  Lighthill  (1958,  p.  64),  if  for  any  sequence 

00 

{b„}  which  isO(n)asn-><»,y  ba  is  absolutely  convergent 
n  i.n=-<»  n  n,v 

and  tends  to  a  finite  limit  as  v  -»■  0,  then 


(4.3.16) 


lim  I  V  "  ^  ®n  v 
\r*-0  n=-~  n=-coNH0 


But,  for  each  fixed  tcIR^, 


the  arguments  used  in  Exaiq^le  4.3.1,  we  obtain  (4.3.17)  which  is 
similar  to  (3.2.3)  and  is  identical  to  (3.2.4).  It  should  be  noted, 
though,  that  (4.3.4)  cannot  be  obtained  from  Campbell's  result 
(Theorem  3.2.4),  since  the  convergence  in  (3.2.4)  is  not  uniform 
on  compact  sets. 

4.4.  Sampling  Expansions  for  Random  Distributions. 

In  this  section  sampling  expansions  for  stationary  random  distri¬ 
butions  are  considered.  Let  X  =  {X(<|)) ,  <j)€S}  be  a  second  order  random 
distribution.  X  is  said  to  be  weakly  stationary,  if  for  every  h  >  0 
and  (p,ipeS, 

=  E(X(<P)  -XCip))  . 

If  X  is  a  weakly  stationary  random  distribution  (WSRD),  then  there 
exists  a  unique  tempered  distribution  peS'  such  that  for  every  (j),ipeS, 

(4.4.1)  R(4>,<P)  =  E(X(<|.)  •X(iP))  =  p((l)4)  , 

where  ii;(t)  =  ')^(-t)  (Ito,  1954) ,  and  p  has  the  spectral  representation 

CO 

(4.4.2)  pM  =  f  $(u)dM(u)  ,  (peS  , 

-00 

oo 

where  y  is  a  non-negative  measure  on  IR^  such  that  /  <» 

-»  (iV)^ 

for  some  integer  k.  In  this  case  X  is  said  to  be  of  type  k,  and  y 
is  called  the  spectral  measure  of  X. 

Let  B*  be  the  set  of  all  Borel  sets  with  finite  y-measure.  An 

2 

L  (Q) -valued  function  Z  defined  on  8*  is  called  a  random  measure  with 


respect  to  y  if 
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E(Z(Bj)-Z(B2))  =  v(B^nB2)  ,  Bj,B2cB*  . 

Hence  E(Z^(B))  =  y(B),  and  Z(Bj)  i  Z(B2)  if  and  B2  are  disjoint. 
Since  y  is  a-additive,  then  Z(B)  =  whenever  Bj,B2,... 

are  disjoint  sets  in  8*  with  ~  follows  by  (4.4.1) 

and  (4.4.2)  that  there  exists  a  random  measure  Z  with  respect  to  y 
such  that 

00 

X((p)  =  /  $(u)dZ(u)  ,  (peS  . 

-00 

2 

If  H(X)  is  the  linear  subspace  of  L  (n)  generated  by  {X(<J))  ,(J)eS} ,  then 
H(X)  and  L  (y)  are  isometrically  isomorphic  under  the  correspondence 
X(4))i— >  $,  (peS.  A  WSRD  X  is  said  to  be  W^-bandlimited,  Wq  >  0,  if 

y  {  [-WQ.Wp]^}  =  0. 

Theorem  4.4.1.  (a)  If  X  =  {X(<t>) ,  is  a  Wg-bandlimited  WSRD, 

W  >  Wg,  aeV  and  iJjeP[-W,W]  with  a(t)  =  1  =  t/;(t)  on  [-Wg,Wg],  then  for 
every  (peS, 

00 

(4.4.3)  X((J))  =  I  X(t  j^a)(T  j^G^)(ip*<p) 

2W  W 

00 

in  mean-square,  where  Gy^((j))  =  /  ({i(t)dt. 

-00 

(b)  Let  X  =  {X((J)) ,  (J)eS}  be  a  WSRD  with  spectral  measure  y  which 
has  compact  support.  Let  the  closed  set  E  and  W  >  0  be  such  that 
E  3  supp(y)  and  the  translates  {E+2nW}  ,  n  0,  are  disjoint  from 
supp(y) .  Let  a  and  \p  be  any  test  functions  such  that  ip  has  support 
E,  and  a(t)  =  1  =  i|/(t)  on  supp(y).  Then 
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(4.4.4)  XW  =  I  X(t  ^S)(t  ^^(4.)  ,  4>€S  , 

2W  W 

in  mean-square,  where  K^^(t)  =  2^  /  <i'(u)e^^^^^du. 

E 

Proof.  To  prove  (a),  first  let  (JieS  be  such  that  $€l?[-W,W]. 
Then  ^Cu)  =  Ij^__oo$(u+2nW)  is  a  c"”- function  which  is  periodic  with 
period  2W  and  has  the  Fourier  series 

«>  .  iri  ^  u  , 

(4.4.5)  «I>(u)  =  I  ^  4>(^)e  ,  uelR^  , 

n=  *«> 

1 

which  converges  unifonnly  on  IR  .  Since  <{>£P[-W,W], 


ct  „G|,)cw  .  /"  ♦(t)dt 

Iw  -00  ^  ^ 

1  W 

"  2W  /  ®  4>(u)du 

-W 

"  2W  ’ 
we  have  for  the  mean  square  error 


?  N 

ej5(<}.)  =  E|X(4.)  -  I  X(T  ^a)(T  (<D) 

2W  2^ 


''^0  I  N  .  iri 

=  /  l$(u)  -  I  ^  «(^)e 

-W„  n=-N 


There  exists  a  constant  M  >  0  such  that  for  all  N  and  uelR^, 

V!  •  n 

^  N  n  uT  ^ 

l<l'(u)  -  I  ^  4)(^)e  ^  I  s  M  . 

n=“N 

Since,  by  (4.4.5),  ^  ^  converges  to  $(u)  on 

2 

[■Wq,Wq],  by  the  dominated  convergence  theorem,  ej^((}>)  -*■  0  as  N  -*■  «>. 
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Thus  for  evety  <|)cP[-W,W],  we  have 


(4.4.6)  X(.j>)  =  I  X(T  ^S)(T  ^Gj^)((D) 

2W  W 


Now  for  every  (peS  and  ip  as  in  part  (a)  of  the  statement  of 
the  theorem,  we  have 

"o  .  "o  . 

X(4i)  =  /  (|)(u)dZ(u)  =  /  i|)(u)<t>(u)dZ(u) 


(4.4.7) 


=  /  (ii)*(|))''(u)dZ(u)  =  X($*(t))  , 


V 

where  ip»<p  =  (#)^€^[-W,W] ,  and  (4.4.3)  follows  from  (4.4.6)  and  (4.4.7) 
The  proof  of  part  (b)  is  similar  to  that  of  (a)  with  the  obvious  modifi 
cation  and  hence  is  omitted.  □ 


It  should  be  noted  that,  since  a  =  1  on  [-Wq,Wq], 

-  y 

X(t  „a)  =  /  e  dZ(u)  ,  nelN  . 

W  ”o 


If  we  define 


x(t)  =  /  e'^^^^“dZ(u)  ,  tcIR^  , 


then  {x(t),  tcR^}  is  a  weakly  stationary  WQ-bandlimited  stochastic 
process,  X(t  ^^ot)  ■  ai'd  (4.4.3)  reads 

m 


(4.4.8)  X((^)  “  ^  » 

n-»  ^ 


90 


i.e.,  the  random  distribution  X  is  reconstructed  using  the  san^les 
of  the  ordinary  stochastic  process  x.  Hence  there  is  a  one-to-one 
correspondence  between  WQ-bandlimited  weakly  stationary  random  dis¬ 
tributions  X  and  W^-bandlimited  weakly  stationary  processes  x  deter- 
mined  by  X((j))  =  /  ®$(u)dZ(u)  and  x(t)  *  /  ^e^^^^^dZ(u)  and  satisfying 

-Wq 

(4.4.8).  ^ 

We  now  show  that  the  sanpling  theoran  for  bandlimited  weakly 
stationary  random  distributions  includes  as  a  particular  case  the 
sampling  theorem  for  bandlimited  weakly  stationary  processes. 

Example  4.4.1.  Let  x  *  {x(t),  telR^}  be  a  measurable,  mean-square 
continuous,  weakly  stationary  process  which  is  Wq -bandlimited,  i.e.. 


(4.4.9) 


x(t)  =  /  e'^’'^^“dZ(u)  , 


where  Z  is  a  random  measure  with  respect  to  the  spectral  measure  y  of 
X  with  y{[  ’WqjWq]^}  *  0.  Then  x  determines  a  WQ-bandlimited  WSRD  by 

“o. 

x(«  -  /  iKujdZCu)  ,  *.5  , 


which  can  also  bo  written  as 


0  «> 


X(<>)  =  /  (  /  e’2''^^''(f(t)dt)dZ(u) 


-Wq  -CO 


=  /  x(t)^(t)dt  , 


where  the  latter  integral  exists  both  with  probability  one  as  well 
as  in  quadratic  mean.  Then  by  (4.4.4)  we  have  for  each  telR^  and 

V  >  0, 


r' 


(4.4.10)  /  x(u)(|)^(t-u)du  »  I  x(^)  /  Kj^(u  -  ^)<|)^(t-u)du 


f|S-00  -OO 


in  quadratic  mean.  As  in  Example  4.3.1, 


/  x(u)(|)^(t-u)du  -*■  x(t)  as  v4’0 

•oo 

oo 

in  quadratic  mean,  /  K^(u  -  ^)<{>^(t-u)du  -»■  K^^Ct  -  as  v4-0,  and 

— OO 

the  right  hand  side  of  (4.4.10)  converges  in  quadratic  mean  to 
'  2W^  *  thus  obtain 

OO 

^(t)  ~  ^  ”  2W^  ’  tcIR 


in  quadratic  mean. 
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